00000001:02000400:2.0F:1782727317.311774:0:3095:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_hostid 00000001:02000400:2.0:1782727333.052858:0:3319:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1782727334.986332:0:3381:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 587 MB/s 00000001:01000000:3.0F:1782727335.235575:0:3381:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 743 MB/s 00000001:01000000:2.0:1782727335.485465:0:3381:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3675 MB/s 00000020:02000000:2.0:1782727336.262677:0:3412:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_83_gbddb8b7 00000400:02000000:1.0F:1782727337.177706:0:3427:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.204.135@tcp [8/256/0/180] 00008000:02000000:3.0:1782727340.654559:0:3577:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0F:1782727388.084882:0:5180:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1782727401.386707:0:5929:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782727401.386712:0:5929:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1782727401.386714:0:5929:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1782727401.386862:0:5929:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000bc721e7b 00000080:02000400:2.0:1782727401.386872:0:5929:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1782727401.396120:0:5929:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1782727401.396135:0:5929:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1782727401.396532:0:5929:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000093c4737e) 00000020:00000080:3.0:1782727401.396556:0:5929:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1782727401.472939:0:5929:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1782727401.473014:0:5929:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1782727401.507707:0:5929:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1782727401.508319:0:5929:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1782727401.508328:0:5929:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782727401.508340:0:5929:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8db73d43f5504655 00000020:01000004:3.0:1782727401.508346:0:5929:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1782727401.508351:0:5929:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1782727401.508355:0:5929:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000bc721e7b from MGS 00000020:01000004:3.0:1782727401.508359:0:5929:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1782727401.508368:0:5929:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000b15e96c9) 00000020:00000080:3.0:1782727401.508399:0:5929:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1782727401.508465:0:5929:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bc721e7b from MGS, refs=2 00080000:01000000:3.0:1782727401.508471:0:5929:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782727401.508478:0:5929:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8db73d43f5504663 00000100:00100000:3.0:1782727401.508653:0:5929:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1782727401.508967:0:5929:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1782727401.508974:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1782727401.510114:0:5929:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1782727401.510123:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1782727401.511179:0:5929:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727401.511340:0:5929:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1782727401.511346:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1782727401.512097:0:5929:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1782727401.512105:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1782727401.512930:0:5929:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1782727401.512939:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1782727401.514142:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727401.514147:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727401.514149:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727401.518858:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727401.518866:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727401.518869:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727401.519627:0:5929:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1782727401.523658:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1782727401.769662:0:5929:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3407 MB/s 00000001:01000000:1.0:1782727402.020142:0:5929:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2627 MB/s 00000001:01000000:2.0:1782727402.269699:0:5929:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 463 MB/s 00000001:01000000:2.0:1782727402.520797:0:5929:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 565 MB/s 00080000:10000000:2.0:1782727402.527299:0:5929:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:0.0:1782727402.536116:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1782727402.547334:0:5929:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1782727402.551892:0:5943:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1782727402.552091:0:5929:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1782727402.552148:0:5929:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1782727402.555175:0:5929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1782727402.555223:0:5929:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1782727402.555574:0:5929:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782727402.555740:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1782727402.555747:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1782727402.559619:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1782727402.559634:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1782727402.562948:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1782727402.562960:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1782727402.564772:0:5929:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1782727402.564798:0:5929:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.204.135@tcp' 00000020:01000004:0.0:1782727402.564800:0:5929:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1782727402.564867:0:5929:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.204.135@tcp (typ=mgc) 00000020:00000080:0.0:1782727402.564898:0:5929:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.135@tcp (00000000deedddaa) 00000020:00000080:0.0:1782727402.564915:0:5929:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1782727402.565052:0:5929:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000838c4f3e@MGC192.168.204.135@tcp: add connection 192.168.204.135@tcp at head 00010000:00010000:0.0:1782727402.565220:0:5929:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.135@tcp-0 is initialized 00000040:01000000:0.0:1782727402.565226:0:5929:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 1 is initialized 10000000:01000000:1.0:1782727402.565776:0:5949:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1782727402.567306:0:5929:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.135@tcp (uuid e0332f07-5c7b-4a87-aafc-b3671573fb48) 00000020:00000080:0.0:1782727402.567330:0:5929:0:(genops.c:1406:class_connect()) connect: client e0332f07-5c7b-4a87-aafc-b3671573fb48, cookie 0x8db73d43f5504671 00000100:00080000:0.0:1782727402.567341:0:5929:0:(import.c:512:import_select_connection()) MGC192.168.204.135@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782727402.567346:0:5929:0:(import.c:626:import_select_connection()) MGC192.168.204.135@tcp: import 00000000838c4f3e using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1782727402.567408:0:5929:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000578baf01 x1869325100122240/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782727402.567485:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000578baf01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e0332f07-5c7b-4a87-aafc-b3671573fb48:3442:1869325100122240:0@lo:250: 00000100:00100000:0.0:1782727402.567566:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727402.567640:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100122240 00000100:00100000:0.0:1782727402.567646:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100122240 00000100:00100000:0.0:1782727402.567672:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782727402.567677:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0d835f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3442:x1869325100122240:12345-0@lo:250: 00010000:00080000:0.0:1782727402.567697:0:5944:0:(ldlm_lib.c:1434:target_handle_connect()) MGS: connection from e0332f07-5c7b-4a87-aafc-b3671573fb48@0@lo t0 exp 0000000000000000 cur 126 last 0 00000020:00000080:0.0:1782727402.567718:0:5944:0:(genops.c:1406:class_connect()) connect: client e0332f07-5c7b-4a87-aafc-b3671573fb48, cookie 0x8db73d43f5504678 00000100:00080000:0.0:1782727402.567852:0:5944:0:(import.c:65:import_set_state_nolock()) 00000000b656b60e : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782727402.567917:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0d835f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+5:3442:x1869325100122240:12345-0@lo:250: Request processed in 238us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727402.567925:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782727402.567978:0:3442:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.135@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1782727402.567986:0:3442:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.135@tcp: connect to target with instance 0 00000100:00080000:0.0:1782727402.567994:0:3442:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1782727402.567998:0:3442:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1782727402.568001:0:3442:0:(import.c:65:import_set_state_nolock()) 00000000838c4f3e MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1782727402.568003:0:3442:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1782727402.568009:0:3442:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1782727402.568014:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000578baf01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e0332f07-5c7b-4a87-aafc-b3671573fb48:3442:1869325100122240:0@lo:250: 00000100:00080000:0.0:1782727402.568034:0:5929:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import e0332f07-5c7b-4a87-aafc-b3671573fb48->MGS 00000020:01000004:0.0:1782727402.568050:0:5929:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1782727402.568056:0:5929:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1782727402.568070:0:5929:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000459f4617) 00000020:00000080:0.0:1782727402.568080:0:5929:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:2.0:1782727402.569107:0:5948:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1782727402.608625:0:5929:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782727402.610642:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1782727402.610657:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1782727402.622836:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1782727402.622859:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1782727402.624766:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1782727402.624787:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1782727402.626624:0:5929:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782727402.626796:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1782727402.626802:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1782727402.633941:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1782727402.633957:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1782727402.713013:0:5929:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727402.713249:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1782727402.713256:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1782727402.715563:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1782727402.715587:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1782727402.716694:0:5929:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727402.716900:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782727402.716907:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1782727402.718795:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782727402.718809:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1782727402.723994:0:5929:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782727402.724171:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782727402.724176:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1782727402.727417:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782727402.727508:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1782727402.735783:0:5929:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782727402.736703:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782727402.736711:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1782727402.751066:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782727402.753406:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1782727402.790579:0:5929:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727402.790844:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1782727402.790851:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1782727402.799834:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782727402.799853:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1782727402.800850:0:5929:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1782727402.800860:0:5929:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1782727402.802666:0:5929:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1782727402.802702:0:5929:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1782727402.802708:0:5929:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1782727402.802859:0:5929:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000020:01000004:1.0:1782727402.802906:0:5929:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.135@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1782727402.802911:0:5929:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1782727402.802915:0:5929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782727402.802917:0:5929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727402.802918:0:5929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727402.802919:0:5929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727402.802920:0:5929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727402.802921:0:5929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782727402.802923:0:5929:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782727402.802924:0:5929:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727402.802925:0:5929:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727402.802926:0:5929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727402.802927:0:5929:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782727402.802930:0:5929:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1782727402.802932:0:5929:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782727402.802933:0:5929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782727402.802934:0:5929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727402.802935:0:5929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727402.802935:0:5929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727402.802936:0:5929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727402.802937:0:5929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782727402.802938:0:5929:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782727402.802939:0:5929:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727402.802940:0:5929:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727402.802941:0:5929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727402.802941:0:5929:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782727402.802974:0:5929:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1782727402.802989:0:5929:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f04ca43d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100122368:0@lo:253: 00000100:00100000:1.0:1782727402.803080:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727402.803124:0:5929:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d0bbd008 going to sleep for 11 seconds 00000100:00100000:2.0:1782727402.803207:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100122368 00000100:00100000:2.0:1782727402.803214:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100122368 00000100:00100000:2.0:1782727402.803289:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727402.803298:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035170748 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+5:5929:x1869325100122368:12345-0@lo:253: 20000000:01000000:2.0:1782727402.803352:0:5947:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1782727402.803355:0:5947:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1782727402.804841:0:5968:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1782727402.804907:0:5947:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1782727402.805224:0:5947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782727402.807154:0:5969:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1782727402.807419:0:5947:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1782727402.807424:0:5947:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1782727402.807431:0:5947:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1782727402.807434:0:5947:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1782727402.807576:0:5947:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1782727402.808086:0:5947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782727402.808656:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1782727402.808672:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1782727402.808792:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1782727402.808815:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1782727402.808831:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1782727402.808907:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1782727402.808916:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1782727402.808931:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1782727402.808937:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1782727402.808948:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1782727402.808953:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1782727402.808966:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1782727402.808980:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1782727402.809007:0:5947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1782727402.809013:0:5947:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1782727402.809021:0:5947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782727402.809119:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1782727402.809130:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1782727402.809144:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1782727402.809159:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1782727402.809173:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1782727402.809180:0:5947:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1782727402.809205:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1782727402.809212:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1782727402.809224:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1782727402.809239:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1782727402.809341:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1782727402.809353:0:5947:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1782727402.810188:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1782727402.810203:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1782727402.810217:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1782727402.810230:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1782727402.810570:0:5947:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1782727402.810593:0:5947:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1782727402.810613:0:5947:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1782727402.811045:0:5970:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1782727402.811229:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1782727402.811317:0:5947:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.135@tcp for mdt 20000000:01000000:1.0:1782727402.811320:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.135@tcp (null) (null) (null) 00000040:00080000:1.0:1782727402.811338:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1782727402.811345:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1782727402.811356:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1782727402.811360:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.135@tcp (null) (null) 00000040:00080000:1.0:1782727402.811600:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1782727402.811610:0:5947:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1782727402.811625:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1782727402.811637:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1782727402.811661:0:5947:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1782727402.811663:0:5947:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1782727402.811667:0:5947:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1782727402.811734:0:5947:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1782727402.811736:0:5947:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1782727402.812142:0:5971:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1782727402.812605:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1782727402.812630:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1782727402.812642:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1782727402.812650:0:5947:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1782727402.812651:0:5947:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1782727402.813050:0:5972:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1782727402.813214:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1782727402.813234:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1782727402.813330:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1782727402.813345:0:5947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782727402.813348:0:5947:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1782727402.813352:0:5947:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1782727402.813354:0:5947:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1782727402.813359:0:5947:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1782727402.813365:0:5947:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1782727402.814118:0:5973:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1782727402.814326:0:5947:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1782727402.823350:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1782727402.823683:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1782727402.823714:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1782727402.823735:0:5947:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782727402.823756:0:5947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000038ef7558/0x8db73d43f5504686 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727402.823771:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038ef7558/0x8db73d43f5504686 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727402.823780:0:5947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000038ef7558/0x8db73d43f5504686 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727402.823786:0:5947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000038ef7558/0x8db73d43f5504686 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727402.823792:0:5947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000038ef7558/0x8db73d43f5504686 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727402.823798:0:5947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000038ef7558/0x8db73d43f5504686 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727402.823804:0:5947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000038ef7558 already unused, calling callback (0000000000b2e36c) 00010000:00010000:1.0:1782727402.823808:0:5947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000038ef7558/0x8db73d43f5504686 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727402.823814:0:5947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000038ef7558/0x8db73d43f5504686 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727402.823825:0:5947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000038ef7558/0x8db73d43f5504686 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727402.823847:0:5947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000038ef7558/0x8db73d43f5504686 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727402.823852:0:5947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000038ef7558/0x8db73d43f5504686 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782727402.823895:0:5947:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1782727402.864689:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035170748 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+5:5929:x1869325100122368:12345-0@lo:253: Request processed in 61375us (61592us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727402.864729:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782727402.864886:0:5929:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f04ca43d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100122368:0@lo:253: 10000000:01000000:0.0:1782727402.864910:0:5929:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1782727402.864914:0:5929:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782727402.864917:0:5929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782727402.864918:0:5929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727402.864920:0:5929:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1782727402.864922:0:5929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727402.864923:0:5929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727402.864925:0:5929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782727402.864926:0:5929:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782727402.864928:0:5929:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1782727402.864930:0:5929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727402.864931:0:5929:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782727402.864972:0:5929:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000bc721e7b from lustre-MDT0000 10000000:01000000:0.0:1782727402.865011:0:5929:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1782727402.865015:0:5929:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1782727402.865022:0:5929:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90ae0f4f0000 10000000:01000000:0.0:1782727402.865029:0:5929:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782727402.865039:0:5929:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff90ae0f4f0000 from 1 10000000:01000000:0.0:1782727402.865043:0:5929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782727402.865111:0:5929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 00000000d44373ef/0x8db73d43f550468d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727402.865124:0:5929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 00000000d44373ef/0x8db73d43f550468d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727402.865134:0:5929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 00000000d44373ef/0x8db73d43f550468d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727402.865156:0:5929:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000578baf01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100122496:0@lo:101: 00000100:00100000:0.0:1782727402.865203:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727402.865276:0:5929:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d0bbd008 going to sleep for 11 seconds 00000100:00100000:2.0:1782727402.865696:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100122496 00000100:00100000:2.0:1782727402.865710:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100122496 00000100:00100000:2.0:1782727402.865774:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727402.865784:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fede3f09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+5:5929:x1869325100122496:12345-0@lo:101: 00010000:00010000:2.0:1782727402.865804:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727402.865852:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d4d6ce3a/0x8db73d43f5504694 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f550468d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727402.865888:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d4d6ce3a/0x8db73d43f5504694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f550468d expref: 6 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727402.865899:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d4d6ce3a/0x8db73d43f5504694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f550468d expref: 6 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727402.865918:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d4d6ce3a, rc 0) 00000100:00100000:2.0:1782727402.866642:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fede3f09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+6:5929:x1869325100122496:12345-0@lo:101: Request processed in 856us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727402.866652:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782727402.866777:0:5929:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000578baf01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100122496:0@lo:101: 00010000:00010000:0.0:1782727402.866807:0:5929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 00000000d44373ef/0x8db73d43f550468d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504694 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727402.866821:0:5929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 00000000d44373ef/0x8db73d43f550468d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f5504694 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727402.866933:0:5929:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000578baf01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100122624:0@lo:501: 00000100:00100000:0.0:1782727402.866987:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727402.867038:0:5929:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d0bbd008 going to sleep for 11 seconds 00000100:00100000:1.0:1782727402.867223:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100122624 00000100:00100000:1.0:1782727402.867231:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100122624 00000100:00100000:1.0:1782727402.867310:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782727402.867319:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e55ba294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+6:5929:x1869325100122624:12345-0@lo:501: 00000100:00100000:1.0:1782727402.873309:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e55ba294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+6:5929:x1869325100122624:12345-0@lo:501: Request processed in 5978us (6308us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782727402.873335:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782727402.879877:0:5929:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000578baf01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100122624:0@lo:501: 10000000:01000000:0.0:1782727402.880006:0:5929:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782727402.880192:0:5929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 00000000d44373ef/0x8db73d43f550468d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504694 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727402.880206:0:5929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 00000000d44373ef/0x8db73d43f550468d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504694 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727402.880217:0:5929:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90ae052c9800 10000000:01000000:0.0:1782727402.880226:0:5929:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1782727402.880231:0:5929:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90ae052c9800 10000000:01000000:0.0:1782727402.880234:0:5929:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1782727402.880237:0:5929:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff90ae052c9800 from 1 10000000:01000000:0.0:1782727402.880240:0:5929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1782727402.880289:0:5929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 0000000026f32613/0x8db73d43f550469b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727402.880297:0:5929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 0000000026f32613/0x8db73d43f550469b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727402.880310:0:5929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 0000000026f32613/0x8db73d43f550469b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727402.880336:0:5929:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000578baf01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100122752:0@lo:101: 00000100:00100000:0.0:1782727402.880443:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727402.880524:0:5929:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d0bbd008 going to sleep for 11 seconds 00000100:00100000:2.0:1782727402.880586:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100122752 00000100:00100000:2.0:1782727402.880599:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100122752 00000100:00100000:2.0:1782727402.880672:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782727402.880681:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dba77d18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+6:5929:x1869325100122752:12345-0@lo:101: 00010000:00010000:2.0:1782727402.880699:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727402.880717:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000015ee055/0x8db73d43f55046a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f550469b expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727402.880745:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000015ee055/0x8db73d43f55046a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f550469b expref: 7 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727402.880755:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000015ee055/0x8db73d43f55046a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f550469b expref: 7 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727402.880763:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000015ee055, rc 0) 00000100:00100000:2.0:1782727402.880847:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dba77d18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+7:5929:x1869325100122752:12345-0@lo:101: Request processed in 168us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727402.880855:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782727402.883311:0:5929:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000578baf01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100122752:0@lo:101: 00010000:00010000:0.0:1782727402.883350:0:5929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 0000000026f32613/0x8db73d43f550469b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55046a2 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727402.884305:0:5929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 0000000026f32613/0x8db73d43f550469b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f55046a2 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727402.884344:0:5929:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1782727402.891732:0:5929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 0000000026f32613/0x8db73d43f550469b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55046a2 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727402.891758:0:5929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 0000000026f32613/0x8db73d43f550469b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55046a2 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727402.891769:0:5929:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1782727402.891820:0:5929:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782727402.891829:0:5929:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90ae052c9800 10000000:01000000:0.0:1782727402.891833:0:5929:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1782727402.891836:0:5929:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1782727402.891839:0:5929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782727402.891902:0:5929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 00000000ecb48ad0/0x8db73d43f55046a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727402.891910:0:5929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 00000000ecb48ad0/0x8db73d43f55046a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727402.891924:0:5929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 00000000ecb48ad0/0x8db73d43f55046a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727402.891955:0:5929:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000578baf01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100122880:0@lo:101: 00000100:00100000:0.0:1782727402.892061:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727402.892137:0:5929:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d0bbd008 going to sleep for 11 seconds 00000100:00100000:2.0:1782727402.892406:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100122880 00000100:00100000:2.0:1782727402.892417:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100122880 00000100:00100000:2.0:1782727402.892486:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782727402.892495:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050cc801d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+7:5929:x1869325100122880:12345-0@lo:101: 00010000:00010000:2.0:1782727402.892516:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727402.892541:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006d695eed/0x8db73d43f55046b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f55046a9 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727402.892582:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006d695eed/0x8db73d43f55046b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f55046a9 expref: 8 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727402.892596:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006d695eed/0x8db73d43f55046b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55046a9 expref: 8 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727402.892606:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006d695eed, rc 0) 00000100:00100000:2.0:1782727402.892676:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050cc801d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+8:5929:x1869325100122880:12345-0@lo:101: Request processed in 181us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727402.892684:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782727402.892805:0:5929:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000578baf01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100122880:0@lo:101: 00010000:00010000:3.0:1782727402.892822:0:5929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 00000000ecb48ad0/0x8db73d43f55046a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55046b0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727402.892830:0:5929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 00000000ecb48ad0/0x8db73d43f55046a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f55046b0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727402.892956:0:5929:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000893b9e7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100123008:0@lo:501: 00000100:00100000:3.0:1782727402.892992:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727402.893030:0:5929:0:(client.c:2701:ptlrpc_set_wait()) set 000000002f206237 going to sleep for 11 seconds 00000100:00100000:2.0:1782727402.893164:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100123008 00000100:00100000:2.0:1782727402.893169:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100123008 00000100:00100000:2.0:1782727402.893200:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782727402.893207:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ebc6705 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+8:5929:x1869325100123008:12345-0@lo:501: 00000100:00100000:2.0:1782727402.893363:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ebc6705 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+9:5929:x1869325100123008:12345-0@lo:501: Request processed in 156us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727402.893370:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782727402.893474:0:5929:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000893b9e7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100123008:0@lo:501: 00000100:00100000:3.0:1782727402.893519:0:5929:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000893b9e7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100123136:0@lo:503: 00000100:00100000:3.0:1782727402.893558:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727402.893583:0:5929:0:(client.c:2701:ptlrpc_set_wait()) set 000000002f206237 going to sleep for 11 seconds 00000100:00100000:2.0:1782727402.893640:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100123136 00000100:00100000:2.0:1782727402.893645:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100123136 00000100:00100000:2.0:1782727402.893819:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782727402.893827:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000514fcdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+9:5929:x1869325100123136:12345-0@lo:503: 00000100:00100000:2.0:1782727402.893931:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000514fcdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+9:5929:x1869325100123136:12345-0@lo:503: Request processed in 105us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727402.893938:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782727402.894020:0:5929:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000893b9e7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100123136:0@lo:503: 00000100:00100000:1.0:1782727402.894328:0:5974:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006ca80753 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:5974:1869325100123264:0@lo:502: 00000100:00100000:1.0:1782727402.894366:0:5974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727402.905595:0:5974:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c9ac9c0d going to sleep for 11 seconds 00000100:00100000:3.0:1782727402.906478:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100123264 00000100:00100000:3.0:1782727402.906494:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100123264 00000100:00100000:3.0:1782727402.906590:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782727402.906600:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbab7164 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+9:5974:x1869325100123264:12345-0@lo:502: 00000100:00100000:3.0:1782727402.906821:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbab7164 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+9:5974:x1869325100123264:12345-0@lo:502: Request processed in 221us (12453us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727402.906831:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782727402.906996:0:5974:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006ca80753 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:5974:1869325100123264:0@lo:502: 00000020:01000000:1.0:1782727402.907057:0:5974:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727402.907071:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727402.907074:0:5974:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1782727402.907080:0:5974:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1782727402.907090:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782727402.907120:0:5974:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000004fcd3c4) 00000020:00000080:1.0:1782727402.907144:0:5974:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1782727402.907152:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1782727402.907257:0:5974:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1782727402.907265:0:5974:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8db73d43f55046be 00000020:00000080:1.0:1782727402.907613:0:5974:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1782727402.907618:0:5974:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727402.907622:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727402.907624:0:5974:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1782727402.907627:0:5974:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727402.907630:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727402.907631:0:5974:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1782727402.907634:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782727402.907641:0:5974:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000008250d6b4) 00000020:00000080:1.0:1782727402.907652:0:5974:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1782727402.907656:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1782727402.907658:0:5974:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1782727402.907661:0:5974:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1782727402.907667:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782727402.907710:0:5974:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bc721e7b from lustre-MDT0000, refs=3 00000020:00000080:1.0:1782727402.907728:0:5974:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000f204d7fb) 00000020:00000080:1.0:1782727402.907736:0:5974:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1782727402.907818:0:5974:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1782727402.907824:0:5974:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8db73d43f55046d3 00000020:00000080:1.0:1782727402.907946:0:5974:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1782727402.907953:0:5974:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1782727402.907958:0:5974:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8db73d43f55046da 00080000:01000000:1.0:1782727402.907963:0:5974:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1782727402.907966:0:5974:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8db73d43f55046e1 00080000:10000000:1.0:1782727402.908593:0:5974:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1782727402.908753:0:5974:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1782727402.916181:0:5974:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1782727403.066033:0:5974:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1782727403.066761:0:5974:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1782727403.072213:0:5974:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1782727403.073261:0:5974:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1782727403.081311:0:5974:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000dd3ddd62) 00000020:00000080:0.0:1782727403.081345:0:5974:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1782727403.081488:0:5974:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1782727403.081497:0:5974:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8db73d43f55046ef 00000020:00000080:2.0:1782727403.084072:0:5974:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1782727403.086118:0:5974:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1782727403.109252:0:5974:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1782727403.115541:0:5974:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1782727403.129942:0:5974:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1782727403.139444:0:5974:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1782727403.151687:0:5974:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1782727403.160154:0:5974:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8db73d43f55046f6 00000020:00000080:1.0:1782727403.161191:0:5974:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1782727403.161208:0:5974:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727403.161217:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727403.161220:0:5974:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1782727403.161224:0:5974:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727403.161228:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727403.161229:0:5974:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782727403.161233:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782727403.161234:0:5974:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782727403.161237:0:5974:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727403.161239:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727403.161241:0:5974:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782727403.161243:0:5974:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727403.161248:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727403.161249:0:5974:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1782727403.161254:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1782727403.161423:0:5974:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1782727403.161506:0:5974:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006ca80753 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:5974:1869325100123392:0@lo:502: 00000100:00100000:1.0:1782727403.161611:0:5974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727403.161951:0:5974:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c9ac9c0d going to sleep for 11 seconds 00000100:00100000:3.0:1782727403.162219:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100123392 00000100:00100000:3.0:1782727403.162227:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100123392 00000100:00100000:3.0:1782727403.162839:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782727403.162866:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5d123dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+9:5974:x1869325100123392:12345-0@lo:502: 00000100:00100000:3.0:1782727403.163040:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5d123dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+9:5974:x1869325100123392:12345-0@lo:502: Request processed in 193us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727403.163058:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782727403.163160:0:5974:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006ca80753 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:5974:1869325100123392:0@lo:502: 00000020:01000000:1.0:1782727403.163196:0:5974:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727403.163202:0:5974:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727403.163204:0:5974:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1782727403.163207:0:5974:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1782727403.163885:0:5929:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1782727403.163914:0:5929:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782727403.163934:0:5929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 00000000ecb48ad0/0x8db73d43f55046a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55046b0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727403.163945:0:5929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 00000000ecb48ad0/0x8db73d43f55046a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55046b0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727403.163954:0:5929:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff90ae052c9800 from 1 10000000:01000000:2.0:1782727403.163957:0:5929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782727403.164007:0:5929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 0000000095c067c4/0x8db73d43f55046fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727403.164016:0:5929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 0000000095c067c4/0x8db73d43f55046fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727403.164025:0:5929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 0000000095c067c4/0x8db73d43f55046fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727403.164054:0:5929:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000a661432 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100123520:0@lo:101: 00000100:00100000:2.0:1782727403.164103:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727403.164496:0:5929:0:(client.c:2701:ptlrpc_set_wait()) set 000000009b8b4cd9 going to sleep for 11 seconds 00000100:00100000:0.0:1782727403.164927:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100123520 00000100:00100000:0.0:1782727403.164936:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100123520 00000100:00100000:0.0:1782727403.164977:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782727403.164985:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064a9a6af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+9:5929:x1869325100123520:12345-0@lo:101: 00010000:00010000:0.0:1782727403.164999:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727403.165016:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004aac0720/0x8db73d43f5504704 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f55046fd expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727403.165113:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004aac0720/0x8db73d43f5504704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f55046fd expref: 10 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727403.165126:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004aac0720/0x8db73d43f5504704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55046fd expref: 10 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727403.165135:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004aac0720, rc 0) 00000100:00100000:0.0:1782727403.165236:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064a9a6af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+10:5929:x1869325100123520:12345-0@lo:101: Request processed in 251us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727403.165244:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782727403.165613:0:5929:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000a661432 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100123520:0@lo:101: 00010000:00010000:1.0:1782727403.165631:0:5929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 0000000095c067c4/0x8db73d43f55046fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504704 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.165652:0:5929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 0000000095c067c4/0x8db73d43f55046fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f5504704 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727403.172704:0:5929:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000580020be pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100123648:0@lo:256: 00000100:00100000:3.0:1782727403.173007:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727403.173194:0:5929:0:(client.c:2701:ptlrpc_set_wait()) set 000000005223b4ae going to sleep for 11 seconds 00000100:00100000:0.0:1782727403.174025:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100123648 00000100:00100000:0.0:1782727403.174036:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100123648 00000100:00100000:0.0:1782727403.174255:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782727403.174264:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000105537f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+10:5929:x1869325100123648:12345-0@lo:256: 20000000:01000000:0.0:1782727403.174289:0:5946:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1782727403.174295:0:5946:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1782727403.174610:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000105537f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+10:5929:x1869325100123648:12345-0@lo:256: Request processed in 346us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727403.174618:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782727403.174891:0:5929:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000580020be pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100123648:0@lo:256: 10000000:01000000:3.0:1782727403.175993:0:5929:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782727403.176073:0:5929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 0000000095c067c4/0x8db73d43f55046fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504704 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727403.176086:0:5929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 0000000095c067c4/0x8db73d43f55046fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504704 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727403.176096:0:5929:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff90ae052c9800 from 1 10000000:01000000:3.0:1782727403.176099:0:5929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782727403.176136:0:5929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 00000000c228bc9b/0x8db73d43f550470b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727403.176144:0:5929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 00000000c228bc9b/0x8db73d43f550470b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727403.176152:0:5929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 00000000c228bc9b/0x8db73d43f550470b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727403.176170:0:5929:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000580020be pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100123776:0@lo:101: 00000100:00100000:3.0:1782727403.176218:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727403.176247:0:5929:0:(client.c:2701:ptlrpc_set_wait()) set 000000005223b4ae going to sleep for 11 seconds 00000100:00100000:2.0:1782727403.176491:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100123776 00000100:00100000:2.0:1782727403.176498:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100123776 00000100:00100000:2.0:1782727403.176546:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782727403.176553:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000817c3221 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+10:5929:x1869325100123776:12345-0@lo:101: 00010000:00010000:2.0:1782727403.176566:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727403.176579:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b1953e88/0x8db73d43f5504712 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f550470b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727403.176613:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b1953e88/0x8db73d43f5504712 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f550470b expref: 11 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727403.176622:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b1953e88/0x8db73d43f5504712 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f550470b expref: 11 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727403.176631:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b1953e88, rc 0) 00000100:00100000:2.0:1782727403.176671:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000817c3221 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+11:5929:x1869325100123776:12345-0@lo:101: Request processed in 119us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727403.176678:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782727403.177268:0:5929:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000580020be pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100123776:0@lo:101: 00010000:00010000:0.0:1782727403.177283:0:5929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 00000000c228bc9b/0x8db73d43f550470b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504712 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727403.177304:0:5929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 00000000c228bc9b/0x8db73d43f550470b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f5504712 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727403.177405:0:5929:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000060c12a9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100123904:0@lo:501: 00000100:00100000:0.0:1782727403.177439:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727403.177484:0:5929:0:(client.c:2701:ptlrpc_set_wait()) set 0000000008b70b61 going to sleep for 11 seconds 00000100:00100000:2.0:1782727403.177678:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100123904 00000100:00100000:2.0:1782727403.177684:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100123904 00000100:00100000:2.0:1782727403.177728:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782727403.177735:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008edb45aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+11:5929:x1869325100123904:12345-0@lo:501: 00000100:00100000:2.0:1782727403.178117:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008edb45aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+11:5929:x1869325100123904:12345-0@lo:501: Request processed in 382us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727403.178125:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782727403.178325:0:5929:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000060c12a9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100123904:0@lo:501: 00000100:00100000:0.0:1782727403.178356:0:5929:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000060c12a9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100124032:0@lo:503: 00000100:00100000:0.0:1782727403.178439:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727403.178573:0:5929:0:(client.c:2701:ptlrpc_set_wait()) set 0000000008b70b61 going to sleep for 11 seconds 00000100:00100000:3.0:1782727403.178645:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100124032 00000100:00100000:3.0:1782727403.178651:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100124032 00000100:00100000:3.0:1782727403.178688:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782727403.178704:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000363aca4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+11:5929:x1869325100124032:12345-0@lo:503: 00000040:00080000:3.0:1782727403.178743:0:5947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782727403.178797:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000363aca4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+11:5929:x1869325100124032:12345-0@lo:503: Request processed in 95us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727403.178805:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782727403.179103:0:5929:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000060c12a9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100124032:0@lo:503: 00000040:00080000:3.0:1782727403.182669:0:5978:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1782727403.187150:0:5929:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1782727403.187191:0:5929:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782727403.187337:0:5929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 00000000c228bc9b/0x8db73d43f550470b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504712 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727403.187352:0:5929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 00000000c228bc9b/0x8db73d43f550470b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504712 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727403.187749:0:5929:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782727403.187763:0:5929:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90ae052c9800 10000000:01000000:2.0:1782727403.187766:0:5929:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90ae052c9800 10000000:01000000:2.0:1782727403.187785:0:5929:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782727403.187792:0:5929:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff90ae052c9800 from 1 10000000:01000000:2.0:1782727403.187795:0:5929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782727403.187834:0:5929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 000000007528f33d/0x8db73d43f5504719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727403.187844:0:5929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 000000007528f33d/0x8db73d43f5504719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727403.187855:0:5929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 000000007528f33d/0x8db73d43f5504719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727403.187889:0:5929:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002faea2f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100124160:0@lo:101: 00000100:00100000:2.0:1782727403.187983:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727403.188195:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100124160 00000100:00100000:0.0:1782727403.188204:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100124160 00000100:00100000:0.0:1782727403.188261:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782727403.188269:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a8a57ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+11:5929:x1869325100124160:12345-0@lo:101: 00010000:00010000:0.0:1782727403.188304:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727403.188318:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ff5ddb82/0x8db73d43f5504720 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f5504719 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727403.188343:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ff5ddb82/0x8db73d43f5504720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f5504719 expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727403.188354:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ff5ddb82/0x8db73d43f5504720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504719 expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727403.188363:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ff5ddb82, rc 0) 00000100:00100000:0.0:1782727403.188426:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a8a57ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5929:x1869325100124160:12345-0@lo:101: Request processed in 159us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727403.188434:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782727403.188680:0:5929:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e1b80a2c going to sleep for 11 seconds 00000100:00100000:2.0:1782727403.188709:0:5929:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002faea2f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100124160:0@lo:101: 00010000:00010000:2.0:1782727403.188723:0:5929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 000000007528f33d/0x8db73d43f5504719 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504720 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727403.188732:0:5929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 000000007528f33d/0x8db73d43f5504719 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f5504720 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727403.188867:0:5929:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002faea2f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100124288:0@lo:501: 00000100:00100000:2.0:1782727403.188896:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727403.188914:0:5929:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e1b80a2c going to sleep for 11 seconds 00000100:00100000:0.0:1782727403.189110:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100124288 00000100:00100000:0.0:1782727403.189116:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100124288 00000100:00100000:0.0:1782727403.189153:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782727403.189161:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9cac9c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5929:x1869325100124288:12345-0@lo:501: 00000100:00100000:0.0:1782727403.189306:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9cac9c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5929:x1869325100124288:12345-0@lo:501: Request processed in 147us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727403.189313:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782727403.189595:0:5929:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002faea2f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100124288:0@lo:501: 00000100:00100000:2.0:1782727403.189626:0:5929:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002faea2f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100124416:0@lo:503: 00000100:00100000:2.0:1782727403.189684:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727403.189730:0:5929:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e1b80a2c going to sleep for 11 seconds 00000100:00100000:1.0:1782727403.189832:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100124416 00000100:00100000:1.0:1782727403.189837:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100124416 00000100:00100000:1.0:1782727403.189880:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782727403.189887:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063ff67c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5929:x1869325100124416:12345-0@lo:503: 00000100:00100000:1.0:1782727403.189978:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063ff67c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5929:x1869325100124416:12345-0@lo:503: Request processed in 92us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727403.189985:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782727403.190145:0:5929:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002faea2f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100124416:0@lo:503: 00000100:00100000:2.0:1782727403.191219:0:5979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002faea2f2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:5979:1869325100124544:0@lo:502: 00000100:00100000:2.0:1782727403.191281:0:5979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727403.191480:0:5979:0:(client.c:2701:ptlrpc_set_wait()) set 00000000487b9528 going to sleep for 11 seconds 00000100:00100000:1.0:1782727403.191645:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100124544 00000100:00100000:1.0:1782727403.191653:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100124544 00000100:00100000:1.0:1782727403.191737:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782727403.191745:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060fa317b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5979:x1869325100124544:12345-0@lo:502: 00000100:00100000:1.0:1782727403.191906:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060fa317b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5979:x1869325100124544:12345-0@lo:502: Request processed in 161us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727403.191914:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782727403.192149:0:5979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002faea2f2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:5979:1869325100124544:0@lo:502: 00000020:01000004:3.0:1782727403.192212:0:5979:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1782727403.192228:0:5979:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000848911b2) 00000020:00000080:3.0:1782727403.192249:0:5979:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1782727403.192677:0:5979:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bc721e7b from lustre-MDT0000, refs=4 00000020:01000004:3.0:1782727403.192682:0:5979:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000bc721e7b from lustre-MDT0000, refs=4 00000020:01000004:3.0:1782727403.192685:0:5979:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000bc721e7b 4 00010000:00080000:3.0:1782727403.192722:0:5979:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000084703c5b@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:3.0:1782727403.206123:0:5979:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1782727403.206296:0:5979:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1782727403.206499:0:5979:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782727403.206586:0:5979:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8db73d43f550472e 00000100:00080000:3.0:1782727403.206669:0:5979:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782727403.206678:0:5979:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000084703c5b using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1782727403.206732:0:5979:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001851e284 x1869325100124672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782727403.206878:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001851e284 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325100124672:0@lo:38: 00000100:00100000:0.0:1782727403.206984:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782727403.207082:0:5979:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782727403.207239:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100124672 00000100:00100000:2.0:1782727403.207255:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100124672 00000100:00100000:2.0:1782727403.207585:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782727403.207593:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005947642b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3442:x1869325100124672:12345-0@lo:38: 00000100:00100000:2.0:1782727403.207689:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005947642b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3442:x1869325100124672:12345-0@lo:38: Request processed in 95us (705us total) trans 0 rc -11/-11 00000100:00100000:0.0:1782727403.207892:0:3442:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782727403.207901:0:3442:0:(import.c:65:import_set_state_nolock()) 0000000084703c5b lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782727403.207906:0:3442:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1782727403.207910:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001851e284 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325100124672:0@lo:38: 00000100:00100000:2.0:1782727403.207980:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727403.220504:0:5979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007ec362f0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:5979:1869325100124800:0@lo:502: 00000100:00100000:0.0:1782727403.222919:0:5979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727403.223055:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100124800 00000100:00100000:2.0:1782727403.223064:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100124800 00000100:00100000:2.0:1782727403.223123:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782727403.223131:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000399d5b07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5979:x1869325100124800:12345-0@lo:502: 00000100:00100000:0.0:1782727403.223172:0:5979:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e2583134 going to sleep for 11 seconds 00000100:00100000:2.0:1782727403.223546:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000399d5b07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5979:x1869325100124800:12345-0@lo:502: Request processed in 161us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727403.223649:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782727403.223795:0:5979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007ec362f0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:5979:1869325100124800:0@lo:502: 00000040:00080000:0.0:1782727403.223835:0:5979:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1782727403.224073:0:5929:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1782727403.224098:0:5929:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782727403.224214:0:5929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 000000007528f33d/0x8db73d43f5504719 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504720 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.224226:0:5929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 000000007528f33d/0x8db73d43f5504719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504720 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782727403.224282:0:5929:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782727403.224285:0:5929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782727403.224290:0:5929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727403.224470:0:5929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727403.224473:0:5929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727403.224474:0:5929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727403.224475:0:5929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782727403.224477:0:5929:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782727403.224478:0:5929:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727403.224479:0:5929:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727403.224480:0:5929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727403.224482:0:5929:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782727403.224485:0:5929:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1782727403.224487:0:5929:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782727403.224489:0:5929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782727403.224490:0:5929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727403.224491:0:5929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727403.224492:0:5929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727403.224493:0:5929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727403.224494:0:5929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782727403.224494:0:5929:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782727403.224495:0:5929:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727403.224496:0:5929:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727403.224497:0:5929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727403.224498:0:5929:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782727403.224585:0:5929:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1782727403.224605:0:5929:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006ca80753 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100124928:0@lo:253: 00000100:00100000:1.0:1782727403.224663:0:5929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727403.225933:0:5929:0:(client.c:2701:ptlrpc_set_wait()) set 0000000091136fe5 going to sleep for 11 seconds 00000100:00100000:0.0:1782727403.226129:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100124928 00000100:00100000:0.0:1782727403.226138:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100124928 00000100:00100000:0.0:1782727403.226232:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782727403.226239:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cbac6f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5929:x1869325100124928:12345-0@lo:253: 20000000:01000000:0.0:1782727403.226274:0:5947:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1782727403.226296:0:5947:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1782727403.248061:0:5947:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782727403.248092:0:5947:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1782727403.248299:0:5968:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782727403.248304:0:5968:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782727403.248327:0:5968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000865ab426/0x8db73d43f5504735 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727403.248350:0:5968:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004aac0720/0x8db73d43f5504704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55046fd expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727403.248361:0:5968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000865ab426/0x8db73d43f5504735 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727403.248452:0:5968:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004aac0720/0x8db73d43f5504704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f55046fd expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727403.248467:0:5968:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004aac0720/0x8db73d43f5504704 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f55046fd expref: 12 pid: 5946 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727403.248480:0:5968:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000814c21b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5968:1869325100125056:0@lo:104: 00000100:00100000:2.0:1782727403.248551:0:5968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727403.248616:0:5968:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d257e6ef going to sleep for 11 seconds 00000100:00100000:3.0:1782727403.248766:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100125056 00000100:00100000:3.0:1782727403.248783:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100125056 00000100:00100000:3.0:1782727403.248874:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727403.248885:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000374bee75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:5968:x1869325100125056:12345-0@lo:104: 00010000:00010000:3.0:1782727403.248905:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: 0000000095c067c4/0x8db73d43f55046fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f5504704 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727403.249025:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782727403.249031:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000374bee75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:5968:x1869325100125056:12345-0@lo:104: Request processed in 148us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727403.249040:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1782727403.249166:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727403.249172:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: 0000000095c067c4/0x8db73d43f55046fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f5504704 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727403.249182:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000095c067c4 already unused, calling callback (000000008a783d59) 10000000:00010000:0.0:1782727403.249185:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: 0000000095c067c4/0x8db73d43f55046fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f5504704 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727403.249194:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: 0000000095c067c4/0x8db73d43f55046fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f5504704 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727403.249201:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: 0000000095c067c4/0x8db73d43f55046fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f5504704 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727403.249207:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727403.249249:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: 0000000095c067c4/0x8db73d43f55046fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504704 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727403.249269:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727403.249285:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: 0000000095c067c4/0x8db73d43f55046fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504704 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727403.249303:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: 0000000095c067c4/0x8db73d43f55046fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504704 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727403.249323:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727403.249325:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727403.249326:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727403.249471:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cbac6f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5929:x1869325100124928:12345-0@lo:253: Request processed in 23230us (24806us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727403.249483:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782727403.249966:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a2cd6b58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0332f07-5c7b-4a87-aafc-b3671573fb48:3444:1869325100125184:0@lo:103: 00000100:00100000:2.0:1782727403.250012:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727403.250136:0:5968:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000814c21b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5968:1869325100125056:0@lo:104: 00010000:00010000:2.0:1782727403.250170:0:5968:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000865ab426/0x8db73d43f5504735 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727403.250183:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100125184 00000100:00100000:1.0:1782727403.250194:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100125184 00010000:00010000:1.0:1782727403.250228:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004aac0720/0x8db73d43f5504704 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55046fd expref: 12 pid: 5946 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727403.250275:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727403.250282:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c4741ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:3444:x1869325100125184:12345-0@lo:103: 00010000:00010000:1.0:1782727403.250297:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727403.250303:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004aac0720/0x8db73d43f5504704 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55046fd expref: 12 pid: 5946 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.250329:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004aac0720/0x8db73d43f5504704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f55046fd expref: 12 pid: 5946 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.250348:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004aac0720/0x8db73d43f5504704 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f55046fd expref: 12 pid: 5946 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.250367:0:5937:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000865ab426/0x8db73d43f5504735 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.250420:0:5937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000865ab426/0x8db73d43f5504735 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782727403.250440:0:5937:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002135821s 00010000:00010000:1.0:1782727403.250446:0:5937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000865ab426/0x8db73d43f5504735 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.250453:0:5937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000865ab426/0x8db73d43f5504735 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727403.250460:0:5929:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006ca80753 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:5929:1869325100124928:0@lo:253: 00010000:00010000:1.0:1782727403.250464:0:5937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000865ab426/0x8db73d43f5504735 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.250476:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000865ab426/0x8db73d43f5504735 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727403.250480:0:5929:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00010000:00010000:1.0:1782727403.250484:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000865ab426 already unused, calling callback (0000000000b2e36c) 00000020:01000004:0.0:1782727403.250486:0:5929:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00010000:00010000:1.0:1782727403.250492:0:5937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000865ab426/0x8db73d43f5504735 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782727403.250493:0:5929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782727403.250502:0:5929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727403.250506:0:5929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727403.250512:0:5929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727403.250519:0:5929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727403.250520:0:5929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782727403.250521:0:5929:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782727403.250522:0:5929:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727403.250524:0:5929:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727403.250525:0:5929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727403.250527:0:5929:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1782727403.250534:0:5937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000865ab426/0x8db73d43f5504735 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:0.0:1782727403.250540:0:5929:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1782727403.250569:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000865ab426/0x8db73d43f5504735 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727403.250585:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727403.251040:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c4741ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+11:3444:x1869325100125184:12345-0@lo:103: Request processed in 758us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727403.251050:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727403.251141:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a2cd6b58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0332f07-5c7b-4a87-aafc-b3671573fb48:3444:1869325100125184:0@lo:103: 00010000:00010000:2.0:1782727403.252612:0:5968:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000865ab426/0x8db73d43f5504735 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727403.252633:0:5968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000865ab426/0x8db73d43f5504735 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727403.252640:0:5968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000865ab426/0x8db73d43f5504735 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1782727403.265331:0:5929:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1782727403.265561:0:5929:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1782727403.265826:0:5929:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1782727403.266006:0:5929:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1782727403.266242:0:5929:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1782727403.266440:0:5929:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1782727403.273898:0:5929:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1782727403.274692:0:5929:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1782727403.274906:0:5929:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1782727403.276274:0:5929:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1782727403.276879:0:5929:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1782727403.278818:0:5929:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1782727403.290891:0:5929:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1782727403.317154:0:5929:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1782727403.317295:0:5984:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1782727403.317299:0:5984:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1782727403.317912:0:5985:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1782727403.320062:0:5929:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1782727403.320206:0:5929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1782727403.324495:0:5929:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1782727403.324520:0:5929:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1782727403.325566:0:5929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782727403.328650:0:5929:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1782727403.329518:0:5985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782727403.329669:0:5929:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1782727403.329722:0:5929:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1782727403.331221:0:5929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1782727403.331482:0:5929:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1782727403.333067:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1782727403.333208:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1782727403.333928:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1782727403.334083:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1782727403.334265:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1782727403.334460:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1782727403.334612:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1782727403.334746:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00000040:00080000:0.0:1782727403.335099:0:5985:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1782727403.335172:0:5985:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1782727403.335178:0:5985:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1782727403.335615:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1782727403.336027:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1782727403.336209:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1782727403.336670:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1782727403.336988:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1782727403.337119:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1782727403.337283:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1782727403.337457:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1782727403.337722:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1782727403.338604:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1782727403.338747:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1782727403.339103:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1782727403.339240:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1782727403.339572:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1782727403.339709:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1782727403.340582:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1782727403.340737:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1782727403.341944:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1782727403.342088:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1782727403.342236:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1782727403.343080:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1782727403.343291:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1782727403.344552:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1782727403.344708:0:5929:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1782727403.345289:0:5929:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1782727403.355271:0:5929:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1782727403.355318:0:5929:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa84181c83988 00100000:10000000:0.0:1782727403.355326:0:5929:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1782727403.356244:0:5929:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782727403.356265:0:5929:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782727403.356290:0:5929:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1782727403.356311:0:5929:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1782727403.358936:0:5929:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782727403.359264:0:5929:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1782727403.563960:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727404.583410:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727405.609670:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727406.629557:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727407.656893:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782727407.875322:0:6230:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1782727408.295345:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782727408.295355:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1782727408.295358:0:38:0:(import.c:65:import_set_state_nolock()) 0000000084703c5b lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782727408.295411:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000084703c5b using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1782727408.295436:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f84a44aa x1869325100125440/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782727408.295597:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782727408.295613:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ad3fdad4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100125312:0@lo:400: 00000100:00100000:1.0:1782727408.295693:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727408.295903:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f84a44aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325100125440:0@lo:38: 00000100:00100000:0.0:1782727408.295939:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727408.296145:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100125440 00000100:00100000:1.0:1782727408.296153:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100125440 00000100:00100000:1.0:1782727408.296198:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782727408.296205:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0116b31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3442:x1869325100125440:12345-0@lo:38: 00010000:00080000:1.0:1782727408.296230:0:5954:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 132 last 0 00000020:00000080:1.0:1782727408.296265:0:5954:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8db73d43f550473c 00000100:00100000:3.0:1782727408.298143:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100125312 00000100:00100000:3.0:1782727408.298158:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100125312 00000100:00100000:3.0:1782727408.298233:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782727408.298241:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f24b29ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+11:3446:x1869325100125312:12345-0@lo:400: 00000100:00100000:3.0:1782727408.298332:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f24b29ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+11:3446:x1869325100125312:12345-0@lo:400: Request processed in 93us (2640us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727408.298341:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782727408.299126:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ad3fdad4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100125312:0@lo:400: 00000004:00100000:1.0:1782727408.302138:0:5954:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782727408.302298:0:5954:0:(import.c:65:import_set_state_nolock()) 000000001a12bab5 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782727408.302419:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0116b31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1869325100125440:12345-0@lo:38: Request processed in 6212us (6478us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727408.302430:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782727408.303016:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f84a44aa x1869325100125440/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782727418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782727408.303035:0:3442:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1782727408.303043:0:3442:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1782727408.303059:0:3442:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782727408.303062:0:3442:0:(import.c:65:import_set_state_nolock()) 0000000084703c5b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782727408.303068:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f84a44aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3442:1869325100125440:0@lo:38: 00010000:00010000:0.0:1782727408.681420:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782727408.817287:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782727408.817299:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff90ae052c9800 from 3 10000000:01000000:3.0:1782727408.817307:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782727408.817364:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 00000000636cf82d/0x8db73d43f5504743 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727408.817392:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 00000000636cf82d/0x8db73d43f5504743 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727408.817419:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 00000000636cf82d/0x8db73d43f5504743 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727408.817448:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006584d3fd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100125568:0@lo:101: 00000100:00100000:3.0:1782727408.817537:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727408.817589:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100125568 00000100:00100000:3.0:1782727408.817597:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100125568 00000100:00100000:3.0:1782727408.817649:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782727408.817657:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b59ae59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+11:5949:x1869325100125568:12345-0@lo:101: 00010000:00010000:3.0:1782727408.817678:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727408.817696:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000545b2e47/0x8db73d43f550474a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f5504743 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727408.817722:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000545b2e47/0x8db73d43f550474a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f5504743 expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727408.817733:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000545b2e47/0x8db73d43f550474a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504743 expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727408.817743:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000545b2e47, rc 0) 00000100:00100000:3.0:1782727408.817786:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b59ae59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5949:x1869325100125568:12345-0@lo:101: Request processed in 129us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727408.817794:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782727408.817854:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ef4a3460 going to sleep for 11 seconds 00000100:00100000:3.0:1782727408.817879:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006584d3fd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100125568:0@lo:101: 00010000:00010000:3.0:1782727408.817894:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 00000000636cf82d/0x8db73d43f5504743 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550474a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727408.817914:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 00000000636cf82d/0x8db73d43f5504743 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f550474a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727408.817963:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006584d3fd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100125696:0@lo:256: 00000100:00100000:3.0:1782727408.817992:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727408.818012:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100125696 00000100:00100000:3.0:1782727408.818016:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100125696 00000100:00100000:3.0:1782727408.818039:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727408.818044:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5949:x1869325100125696:12345-0@lo:256: 20000000:01000000:3.0:1782727408.818058:0:5946:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782727408.818077:0:5946:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782727408.818080:0:5946:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1782727408.818149:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5949:x1869325100125696:12345-0@lo:256: Request processed in 104us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727408.818156:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727408.818174:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ef4a3460 going to sleep for 11 seconds 00000100:00100000:3.0:1782727408.818184:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006584d3fd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100125696:0@lo:256: 10000000:01000000:3.0:1782727408.818221:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782727408.818227:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: 00000000636cf82d/0x8db73d43f5504743 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550474a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727408.818235:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: 00000000636cf82d/0x8db73d43f5504743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550474a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1782727408.898662:0:6282:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782727408.898968:0:6282:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782727409.701572:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727410.726449:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727411.750464:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782727412.181014:0:6385:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782727412.181337:0:6385:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782727412.775967:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782727413.196444:0:6433:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff54a22300 20000000:00000080:3.0:1782727413.196468:0:6433:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90ae3b1e0000 uarg=0000000000000000 20000000:01000000:3.0:1782727413.196504:0:6433:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1782727413.196512:0:6433:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1782727413.196516:0:6433:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1782727413.196589:0:6433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1782727413.196600:0:6433:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1782727413.200803:0:6433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782727413.201139:0:6433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782727413.201173:0:6433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1782727413.201189:0:6433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1782727413.201204:0:6433:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782727413.201222:0:6433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000085f67f15/0x8db73d43f5504751 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.201241:0:6433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b1953e88/0x8db73d43f5504712 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f550470b expref: 11 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.201248:0:6433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000085f67f15/0x8db73d43f5504751 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.201294:0:6433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b1953e88/0x8db73d43f5504712 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f550470b expref: 11 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727413.201308:0:6433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b1953e88/0x8db73d43f5504712 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f550470b expref: 11 pid: 5944 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727413.201321:0:6433:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006584d3fd pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6433:1869325100125824:0@lo:104: 00000100:00100000:3.0:1782727413.201755:0:6433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727413.201861:0:6433:0:(client.c:2701:ptlrpc_set_wait()) set 000000009b83ed9a going to sleep for 11 seconds 00000100:00100000:2.0:1782727413.209284:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100125824 00000100:00100000:2.0:1782727413.209299:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100125824 00000100:00100000:2.0:1782727413.209357:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727413.209363:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b2b5a6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:6433:x1869325100125824:12345-0@lo:104: 00010000:00010000:2.0:1782727413.209395:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: 00000000c228bc9b/0x8db73d43f550470b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f5504712 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.209490:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782727413.209495:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b2b5a6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:6433:x1869325100125824:12345-0@lo:104: Request processed in 132us (7742us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727413.209502:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1782727413.209562:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727413.209567:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: 00000000c228bc9b/0x8db73d43f550470b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f5504712 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.209574:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c228bc9b already unused, calling callback (000000008a783d59) 10000000:00010000:2.0:1782727413.209577:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: 00000000c228bc9b/0x8db73d43f550470b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f5504712 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.209585:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: 00000000c228bc9b/0x8db73d43f550470b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f5504712 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727413.209591:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: 00000000c228bc9b/0x8db73d43f550470b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f5504712 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727413.209596:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782727413.209633:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: 00000000c228bc9b/0x8db73d43f550470b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504712 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.209653:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782727413.209679:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: 00000000c228bc9b/0x8db73d43f550470b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504712 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.209686:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: 00000000c228bc9b/0x8db73d43f550470b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504712 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.209701:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727413.209703:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727413.209704:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727413.209725:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000814c21b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100125952:0@lo:103: 00000100:00100000:2.0:1782727413.209769:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727413.209837:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100125952 00000100:00100000:2.0:1782727413.209842:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100125952 00010000:00010000:2.0:1782727413.209934:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b1953e88/0x8db73d43f5504712 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f550470b expref: 12 pid: 5944 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727413.209955:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727413.209963:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b606bf9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:3446:x1869325100125952:12345-0@lo:103: 00010000:00010000:2.0:1782727413.209974:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727413.209978:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b1953e88/0x8db73d43f5504712 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f550470b expref: 12 pid: 5944 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.209988:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b1953e88/0x8db73d43f5504712 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f550470b expref: 12 pid: 5944 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.210006:0:5938:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000085f67f15/0x8db73d43f5504751 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.210023:0:5938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000085f67f15/0x8db73d43f5504751 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.210038:0:5938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000085f67f15/0x8db73d43f5504751 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.210044:0:5938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000085f67f15/0x8db73d43f5504751 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.210050:0:5938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000085f67f15/0x8db73d43f5504751 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.210056:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000085f67f15/0x8db73d43f5504751 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.210061:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000085f67f15 already unused, calling callback (0000000000b2e36c) 00010000:00010000:2.0:1782727413.210065:0:5938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000085f67f15/0x8db73d43f5504751 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.210070:0:5938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000085f67f15/0x8db73d43f5504751 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.210077:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000085f67f15/0x8db73d43f5504751 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.210086:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727413.210115:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b606bf9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:3446:x1869325100125952:12345-0@lo:103: Request processed in 154us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727413.210121:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727413.210154:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000814c21b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100125952:0@lo:103: 00010000:00010000:2.0:1782727413.210307:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b1953e88/0x8db73d43f5504712 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f550470b expref: 11 pid: 5944 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727413.210320:0:6433:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006584d3fd pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6433:1869325100125824:0@lo:104: 00010000:00010000:2.0:1782727413.210334:0:6433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000085f67f15/0x8db73d43f5504751 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.210343:0:6433:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000085f67f15/0x8db73d43f5504751 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.210348:0:6433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000085f67f15/0x8db73d43f5504751 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727413.210354:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000085f67f15/0x8db73d43f5504751 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727413.414994:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000814c21b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325100126080:0@lo:400: 00000100:00100000:3.0:1782727413.415073:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727413.415280:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100126080 00000100:00100000:0.0:1782727413.415287:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100126080 00000100:00100000:0.0:1782727413.415336:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782727413.415344:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029483bcf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325100126080:12345-0@lo:400: 00000100:00100000:0.0:1782727413.416821:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029483bcf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325100126080:12345-0@lo:400: Request processed in 1472us (1742us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727413.416836:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782727413.417001:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000814c21b x1869325100126080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727413.417017:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000814c21b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325100126080:0@lo:400: 00010000:00010000:1.0:1782727413.797926:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727414.821697:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727415.845560:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727416.870891:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782727416.997488:0:5949:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782727416.997497:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff90ae052c9800 from 1 10000000:01000000:2.0:1782727416.997503:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782727416.997562:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: 00000000a9dd0ffd/0x8db73d43f5504758 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727416.997596:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: 00000000a9dd0ffd/0x8db73d43f5504758 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727416.997609:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: 00000000a9dd0ffd/0x8db73d43f5504758 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727416.997638:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004d8f263c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100126208:0@lo:101: 00000100:00100000:2.0:1782727416.997734:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727416.997794:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f7ddc61c going to sleep for 11 seconds 00000100:00100000:3.0:1782727416.998065:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100126208 00000100:00100000:3.0:1782727416.998077:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100126208 00000100:00100000:3.0:1782727416.998153:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782727416.998163:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000083e3a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+11:5949:x1869325100126208:12345-0@lo:101: 00010000:00010000:3.0:1782727416.998180:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727416.998199:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000045cca9bd/0x8db73d43f550475f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f5504758 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727416.998227:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045cca9bd/0x8db73d43f550475f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f5504758 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727416.998237:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000045cca9bd/0x8db73d43f550475f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504758 expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727416.998246:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000045cca9bd, rc 0) 00000100:00100000:3.0:1782727416.998290:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000083e3a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5949:x1869325100126208:12345-0@lo:101: Request processed in 129us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727416.998297:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782727416.998421:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004d8f263c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100126208:0@lo:101: 00010000:00010000:2.0:1782727416.998438:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: 00000000a9dd0ffd/0x8db73d43f5504758 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550475f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727416.998446:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: 00000000a9dd0ffd/0x8db73d43f5504758 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f550475f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727416.998626:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004d8f263c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100126336:0@lo:501: 00000100:00100000:2.0:1782727416.998658:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727416.998681:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f7ddc61c going to sleep for 11 seconds 00000100:00100000:3.0:1782727416.998789:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100126336 00000100:00100000:3.0:1782727416.998794:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100126336 00000100:00100000:3.0:1782727416.998823:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782727416.998829:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1bcac8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5949:x1869325100126336:12345-0@lo:501: 00000100:00100000:3.0:1782727416.998938:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1bcac8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5949:x1869325100126336:12345-0@lo:501: Request processed in 110us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727416.998945:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782727416.999085:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004d8f263c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100126336:0@lo:501: 00000100:00100000:2.0:1782727416.999109:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004d8f263c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100126464:0@lo:503: 00000100:00100000:2.0:1782727416.999143:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727416.999169:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f7ddc61c going to sleep for 11 seconds 00000100:00100000:3.0:1782727416.999208:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100126464 00000100:00100000:3.0:1782727416.999212:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100126464 00000100:00100000:3.0:1782727416.999235:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782727416.999239:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d93492d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5949:x1869325100126464:12345-0@lo:503: 00000100:00100000:3.0:1782727416.999317:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d93492d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5949:x1869325100126464:12345-0@lo:503: Request processed in 77us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727416.999324:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782727416.999517:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004d8f263c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100126464:0@lo:503: 00000100:00100000:2.0:1782727417.001827:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004d8f263c pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:6605:1869325100126592:0@lo:502: 00000100:00100000:2.0:1782727417.001904:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727417.001942:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set 000000000202ab9e going to sleep for 11 seconds 00000100:00100000:0.0:1782727417.002043:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100126592 00000100:00100000:0.0:1782727417.002049:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100126592 00000100:00100000:0.0:1782727417.002092:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782727417.002098:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001de53d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6605:x1869325100126592:12345-0@lo:502: 00000100:00100000:0.0:1782727417.002210:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001de53d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6605:x1869325100126592:12345-0@lo:502: Request processed in 112us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727417.002218:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782727417.002326:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004d8f263c pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:6605:1869325100126592:0@lo:502: 00000020:01000000:2.0:1782727417.002354:0:6605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782727417.002362:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727417.002364:0:6605:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782727417.002395:0:6605:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff90ae052c9800 00000020:00000080:2.0:1782727417.002398:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782727417.002438:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:6605:1869325100126720:0@lo:502: 00000100:00100000:2.0:1782727417.002662:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727417.002678:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae10fff240 going to sleep for 11 seconds 00000100:00100000:0.0:1782727417.004987:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100126720 00000100:00100000:0.0:1782727417.005003:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100126720 00000100:00100000:0.0:1782727417.005075:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782727417.005086:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6605:x1869325100126720:12345-0@lo:502: 00000100:00100000:0.0:1782727417.005260:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6605:x1869325100126720:12345-0@lo:502: Request processed in 175us (2597us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727417.005290:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782727417.005739:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:6605:1869325100126720:0@lo:502: 00000020:01000000:3.0:1782727417.005776:0:6605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727417.005785:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727417.005787:0:6605:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1782727417.005792:0:6605:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1782727417.006024:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1782727417.006048:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782727417.006057:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7a00/0x8db73d43f5504758 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550475f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727417.006069:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7a00/0x8db73d43f5504758 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550475f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727417.894451:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727418.534022:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782727418.534052:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325100126976:0@lo:400: 00000100:00100000:2.0:1782727418.534059:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100126848:0@lo:400: 00000100:00100000:1.0:1782727418.542087:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727418.542178:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100126976 00000100:00100000:0.0:1782727418.542194:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100126976 00000100:00100000:0.0:1782727418.542286:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782727418.542300:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325100126976:12345-0@lo:400: 00000100:00100000:0.0:1782727418.542439:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325100126976:12345-0@lo:400: Request processed in 142us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727418.542448:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782727418.542736:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90ae0354e300 x1869325100126976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727418.542754:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325100126976:0@lo:400: 00000100:00100000:2.0:1782727418.546106:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727418.548751:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100126848 00000100:00100000:3.0:1782727418.548771:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100126848 00000100:00100000:3.0:1782727418.548849:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782727418.548861:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:3443:x1869325100126848:12345-0@lo:400: 00000100:00100000:3.0:1782727418.548984:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:3443:x1869325100126848:12345-0@lo:400: Request processed in 125us (3506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727418.548993:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782727418.550058:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100126848:0@lo:400: 00010000:00010000:3.0:1782727418.917951:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727419.942128:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727420.967219:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727421.989564:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727423.014466:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782727423.148445:0:6932:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1782727423.148449:0:6932:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1782727423.148450:0:6932:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1782727423.148574:0:6932:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff90ae06bcd800 00000020:01000004:1.0:1782727423.148591:0:6932:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1782727423.148602:0:6932:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1782727423.148616:0:6932:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90ae035cb3a0) 00000020:00000080:1.0:1782727423.148630:0:6932:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1782727423.174458:0:6932:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1782727423.174528:0:6932:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1782727423.207841:0:6932:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1782727423.208651:0:6932:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1782727423.208662:0:6932:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1782727423.208674:0:6932:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8db73d43f550476d 00000020:01000004:0.0:1782727423.208681:0:6932:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1782727423.208703:0:6932:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.135@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1782727423.208711:0:6932:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1782727423.208724:0:6932:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1782727423.208729:0:6932:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1782727423.208739:0:6932:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90ae0f4f33a0) 00000020:00000080:0.0:1782727423.208749:0:6932:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1782727423.213335:0:6932:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782727423.213535:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1782727423.213542:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1782727423.217657:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1782727423.217672:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1782727423.218562:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1782727423.218571:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1782727423.222261:0:6932:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782727423.223130:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1782727423.223137:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1782727423.225617:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1782727423.225634:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1782727423.249189:0:6932:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782727423.249607:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1782727423.249613:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1782727423.253069:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1782727423.253083:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1782727423.254426:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1782727423.254437:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1782727423.258677:0:6932:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727423.258860:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1782727423.258867:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1782727423.263729:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1782727423.263740:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1782727423.340731:0:6932:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782727423.340911:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1782727423.340918:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1782727423.344307:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1782727423.344321:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1782727423.344874:0:6932:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1782727423.344904:0:6932:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1782727423.344911:0:6932:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1782727423.365828:0:6932:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782727423.365872:0:6932:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.135@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1782727423.365876:0:6932:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782727423.365878:0:6932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782727423.365879:0:6932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727423.365881:0:6932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727423.365882:0:6932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727423.365883:0:6932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727423.365885:0:6932:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727423.365886:0:6932:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727423.365888:0:6932:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727423.365889:0:6932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727423.365891:0:6932:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782727423.365895:0:6932:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1782727423.365897:0:6932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782727423.365898:0:6932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782727423.365899:0:6932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727423.365900:0:6932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727423.365901:0:6932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727423.365902:0:6932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727423.365903:0:6932:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727423.365904:0:6932:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727423.365906:0:6932:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727423.365906:0:6932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727423.365908:0:6932:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782727423.365936:0:6932:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1782727423.365956:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100127104:0@lo:253: 00000100:00100000:3.0:1782727423.366043:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727423.366239:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e7b7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727423.366364:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100127104 00000100:00100000:2.0:1782727423.366573:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100127104 00000100:00100000:0.0:1782727423.372081:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782727423.372096:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6932:x1869325100127104:12345-0@lo:253: 20000000:01000000:0.0:1782727423.372135:0:5946:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1782727423.372139:0:5946:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1782727423.372144:0:5946:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1782727423.372147:0:5946:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1782727423.372519:0:5946:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782727423.372641:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1782727423.372654:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1782727423.372670:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1782727423.372675:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1782727423.372686:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1782727423.372700:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1782727423.372783:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1782727423.372798:0:5946:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.135@tcp 20000000:01000000:0.0:1782727423.372800:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.135@tcp (null) (null) (null) 00000040:00080000:0.0:1782727423.372813:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1782727423.372819:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1782727423.372832:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1782727423.372845:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.135@tcp (null) (null) 00000040:00080000:0.0:1782727423.372860:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1782727423.372867:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1782727423.372879:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1782727423.372895:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1782727423.373254:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1782727423.373266:0:5946:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.135@tcp 20000000:01000000:0.0:1782727423.373268:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.135@tcp (null) (null) (null) 00000040:00080000:0.0:1782727423.373280:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1782727423.373285:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1782727423.373296:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1782727423.373300:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.135@tcp (null) (null) 00000040:00080000:0.0:1782727423.373315:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1782727423.373321:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1782727423.373348:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1782727423.373365:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1782727423.373414:0:5946:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1782727423.373416:0:5946:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1782727423.373420:0:5946:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1782727423.373472:0:5946:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782727423.373476:0:5946:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782727423.374235:0:6951:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1782727423.374261:0:6951:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1782727423.374273:0:6951:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1782727423.374586:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1782727423.374608:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1782727423.374630:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1782727423.374641:0:5946:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1782727423.374643:0:5946:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782727423.376905:0:6952:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1782727423.376961:0:6952:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1782727423.376977:0:6952:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1782727423.377235:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1782727423.377257:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1782727423.377271:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1782727423.377282:0:5946:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1782727423.377285:0:5946:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1782727423.377837:0:6953:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1782727423.378112:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1782727423.378132:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1782727423.378145:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:1.0:1782727423.378159:0:5946:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782727423.378178:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90ae013a1200/0x8db73d43f550477b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.378197:0:5946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae0a3c6000/0x8db73d43f5504694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f550468d expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.378215:0:5946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae0a3c6400/0x8db73d43f55046b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55046a9 expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.378223:0:5946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504720 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504719 expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.378232:0:5946:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90ae013a1200/0x8db73d43f550477b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.378271:0:5946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f5504719 expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.378286:0:5946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504720 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f5504719 expref: 12 pid: 5947 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727423.378301:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5946:1869325100127232:0@lo:104: 00000100:00100000:1.0:1782727423.378367:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782727423.378661:0:5946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae0a3c6400/0x8db73d43f55046b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f55046a9 expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.378671:0:5946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae0a3c6400/0x8db73d43f55046b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f55046a9 expref: 12 pid: 5947 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727423.378680:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5946:1869325100127360:0@lo:104: 00000100:00100000:1.0:1782727423.378702:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782727423.379066:0:5946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae0a3c6000/0x8db73d43f5504694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f550468d expref: 12 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.379076:0:5946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae0a3c6000/0x8db73d43f5504694 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f550468d expref: 12 pid: 5946 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727423.379095:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5946:1869325100127488:0@lo:104: 00000100:00100000:1.0:1782727423.379119:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727423.379328:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100127232 00000100:00100000:3.0:1782727423.379336:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100127232 00000100:00100000:3.0:1782727423.379407:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100127360 00000100:00100000:3.0:1782727423.379411:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100127360 00000100:00100000:3.0:1782727423.379426:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782727423.379434:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+4:5946:x1869325100127232:12345-0@lo:104: 00010000:00010000:3.0:1782727423.379446:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7c00/0x8db73d43f5504719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f5504720 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.379509:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782727423.379516:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+4:5946:x1869325100127232:12345-0@lo:104: Request processed in 82us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727423.379522:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782727423.379539:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782727423.379545:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:5946:x1869325100127360:12345-0@lo:104: 00010000:00010000:3.0:1782727423.379553:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae00031000/0x8db73d43f55046a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f55046b0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.379583:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782727423.379588:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:5946:x1869325100127360:12345-0@lo:104: Request processed in 43us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727423.379594:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1782727423.379610:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782727423.379616:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7c00/0x8db73d43f5504719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f5504720 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.379624:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae0a3c7c00 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:3.0:1782727423.379628:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7c00/0x8db73d43f5504719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f5504720 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.379637:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7c00/0x8db73d43f5504719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f5504720 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727423.379650:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7c00/0x8db73d43f5504719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f5504720 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727423.379656:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727423.379684:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7c00/0x8db73d43f5504719 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504720 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.379691:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727423.379705:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7c00/0x8db73d43f5504719 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504720 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.379712:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7c00/0x8db73d43f5504719 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504720 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.379726:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727423.379730:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae00031000/0x8db73d43f55046a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f55046b0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.379736:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae00031000 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:3.0:1782727423.379739:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae00031000/0x8db73d43f55046a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f55046b0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.379746:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae00031000/0x8db73d43f55046a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f55046b0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727423.379753:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae00031000/0x8db73d43f55046a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f55046b0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727423.379759:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727423.379777:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae00031000/0x8db73d43f55046a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55046b0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.379783:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727423.379796:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae00031000/0x8db73d43f55046a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55046b0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.379803:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae00031000/0x8db73d43f55046a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55046b0 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.379812:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727423.379814:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727423.379816:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727423.379833:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100127744:0@lo:103: 00000100:00100000:3.0:1782727423.379873:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727423.379912:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100127744 00000100:00100000:3.0:1782727423.379916:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100127744 00010000:00010000:3.0:1782727423.379934:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae0a3c6400/0x8db73d43f55046b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55046a9 expref: 13 pid: 5947 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727423.379960:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782727423.379966:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:3443:x1869325100127744:12345-0@lo:103: 00010000:00010000:3.0:1782727423.379976:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727423.379981:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae0a3c6400/0x8db73d43f55046b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55046a9 expref: 13 pid: 5947 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.379989:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae0a3c6400/0x8db73d43f55046b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f55046a9 expref: 13 pid: 5947 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.380003:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727423.380034:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:3443:x1869325100127744:12345-0@lo:103: Request processed in 67us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727423.380041:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782727423.380073:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100127744:0@lo:103: 00010000:00010000:0.0:1782727423.380196:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727423.380208:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100127616:0@lo:103: 00000100:00100000:0.0:1782727423.380244:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727423.380358:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100127616 00000100:00100000:1.0:1782727423.380362:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100127616 00010000:00010000:1.0:1782727423.380403:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504720 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f5504719 expref: 13 pid: 5947 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727423.380424:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782727423.380430:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:3446:x1869325100127616:12345-0@lo:103: 00010000:00010000:1.0:1782727423.380437:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727423.380441:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504720 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f5504719 expref: 13 pid: 5947 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.380451:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504720 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f5504719 expref: 13 pid: 5947 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.380471:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727423.380498:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:3446:x1869325100127616:12345-0@lo:103: Request processed in 69us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727423.380505:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782727423.380528:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100127488 00000100:00100000:1.0:1782727423.380531:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100127488 00000100:00100000:1.0:1782727423.380544:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782727423.380550:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:5946:x1869325100127488:12345-0@lo:104: 00010000:00010000:1.0:1782727423.380558:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae00031c00/0x8db73d43f550468d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f5504694 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.380587:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782727423.380597:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:5946:x1869325100127488:12345-0@lo:104: Request processed in 48us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727423.380604:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1782727423.380616:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727423.380620:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae00031c00/0x8db73d43f550468d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f5504694 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.380626:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae00031c00 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:1.0:1782727423.380630:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae00031c00/0x8db73d43f550468d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f5504694 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.380636:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae00031c00/0x8db73d43f550468d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f5504694 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727423.380643:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae00031c00/0x8db73d43f550468d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f5504694 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727423.380649:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782727423.380667:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae00031c00/0x8db73d43f550468d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504694 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.380673:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727423.380682:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae00031c00/0x8db73d43f550468d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504694 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.380689:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae00031c00/0x8db73d43f550468d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504694 expref: -99 pid: 5929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.380704:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727423.380706:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727423.380708:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727423.380721:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0332f07-5c7b-4a87-aafc-b3671573fb48:3444:1869325100127872:0@lo:103: 00000100:00100000:1.0:1782727423.380745:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727423.380767:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100127872 00000100:00100000:1.0:1782727423.380770:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100127872 00010000:00010000:1.0:1782727423.380781:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae0a3c6000/0x8db73d43f5504694 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f550468d expref: 13 pid: 5946 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727423.380798:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782727423.380803:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:3444:x1869325100127872:12345-0@lo:103: 00010000:00010000:1.0:1782727423.380810:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727423.380814:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae0a3c6000/0x8db73d43f5504694 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f550468d expref: 13 pid: 5946 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.380822:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae0a3c6000/0x8db73d43f5504694 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f550468d expref: 13 pid: 5946 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.380834:0:5937:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90ae013a1200/0x8db73d43f550477b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.380841:0:5937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae013a1200/0x8db73d43f550477b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.380854:0:5937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ae013a1200/0x8db73d43f550477b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.380861:0:5937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ae013a1200/0x8db73d43f550477b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727423.380992:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100127616:0@lo:103: 00010000:00010000:1.0:1782727423.381035:0:5937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90ae013a1200/0x8db73d43f550477b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.381051:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90ae013a1200/0x8db73d43f550477b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.381057:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae013a1200 already unused, calling callback (ffffffffc0b2bcf0) 00010000:00010000:1.0:1782727423.381060:0:5937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90ae013a1200/0x8db73d43f550477b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.381067:0:5937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90ae013a1200/0x8db73d43f550477b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.381077:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90ae013a1200/0x8db73d43f550477b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.381086:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727423.381194:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:3444:x1869325100127872:12345-0@lo:103: Request processed in 391us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727423.381201:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782727423.381238:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae06311480 going to sleep for 11 seconds 00010000:00010000:1.0:1782727423.381252:0:5946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504720 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f5504719 expref: 12 pid: 5947 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727423.381262:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5946:1869325100127232:0@lo:104: 00010000:00010000:1.0:1782727423.381270:0:5946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae0a3c6400/0x8db73d43f55046b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f55046a9 expref: 11 pid: 5947 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727423.381279:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5946:1869325100127360:0@lo:104: 00010000:00010000:1.0:1782727423.381285:0:5946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae0a3c6000/0x8db73d43f5504694 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f550468d expref: 10 pid: 5946 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727423.381303:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5946:1869325100127488:0@lo:104: 00010000:00010000:1.0:1782727423.381319:0:5946:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90ae013a1200/0x8db73d43f550477b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.381329:0:5946:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90ae013a1200/0x8db73d43f550477b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.381335:0:5946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90ae013a1200/0x8db73d43f550477b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.381340:0:5946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae013a1200/0x8db73d43f550477b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782727423.381353:0:5946:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1782727423.386788:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0332f07-5c7b-4a87-aafc-b3671573fb48:3444:1869325100127872:0@lo:103: 00000100:00100000:1.0:1782727423.388060:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+9:6932:x1869325100127104:12345-0@lo:253: Request processed in 15960us (22010us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727423.388074:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782727423.388232:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100127104:0@lo:253: 10000000:01000000:3.0:1782727423.388247:0:6932:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1782727423.388251:0:6932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782727423.388253:0:6932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782727423.388255:0:6932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727423.388256:0:6932:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1782727423.388257:0:6932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727423.388259:0:6932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727423.388260:0:6932:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727423.388262:0:6932:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1782727423.388264:0:6932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727423.388265:0:6932:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782727423.388282:0:6932:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90ae06bcd800 from lustre-OST0000 10000000:01000000:3.0:1782727423.388319:0:6932:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1782727423.388322:0:6932:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782727423.388330:0:6932:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90ae0f4f0000 local copy 10000000:01000000:3.0:1782727423.388334:0:6932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782727423.388595:0:6932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae01538200/0x8db73d43f5504782 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.388607:0:6932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.135@tcp lock: ffff90ae01538200/0x8db73d43f5504782 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.388620:0:6932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae01538200/0x8db73d43f5504782 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727423.388639:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100128000:0@lo:101: 00000100:00100000:3.0:1782727423.388678:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727423.388793:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100128000 00000100:00100000:0.0:1782727423.388800:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100128000 00000100:00100000:0.0:1782727423.388850:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782727423.388861:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+9:6932:x1869325100128000:12345-0@lo:101: 00010000:00010000:0.0:1782727423.388875:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727423.388891:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504789 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f5504782 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727423.388913:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f5504782 expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727423.388923:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504782 expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727423.388931:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae00030e00, rc 0) 00000100:00100000:0.0:1782727423.388962:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+10:6932:x1869325100128000:12345-0@lo:101: Request processed in 103us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727423.388968:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782727423.389013:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b3f2240 going to sleep for 11 seconds 00000100:00100000:3.0:1782727423.389027:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100128000:0@lo:101: 00010000:00010000:3.0:1782727423.389040:0:6932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae01538200/0x8db73d43f5504782 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8db73d43f5504789 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.389049:0:6932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae01538200/0x8db73d43f5504782 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8db73d43f5504789 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727423.389166:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100128128:0@lo:501: 00000100:00100000:3.0:1782727423.389191:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727423.389213:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b3f2240 going to sleep for 11 seconds 00000100:00100000:0.0:1782727423.389267:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100128128 00000100:00100000:0.0:1782727423.389273:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100128128 00000100:00100000:0.0:1782727423.389303:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782727423.389310:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+10:6932:x1869325100128128:12345-0@lo:501: 00000100:00100000:0.0:1782727423.389397:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+10:6932:x1869325100128128:12345-0@lo:501: Request processed in 59us (176us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782727423.389415:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782727423.392063:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100128128:0@lo:501: 10000000:01000000:2.0:1782727423.392094:0:6932:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1782727423.392215:0:6932:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1782727423.392225:0:6932:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae01538200/0x8db73d43f5504782 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8db73d43f5504789 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727423.392236:0:6932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae01538200/0x8db73d43f5504782 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8db73d43f5504789 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727423.392244:0:6932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff90ae01538200/0x8db73d43f5504782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8db73d43f5504789 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727423.392332:0:6932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782727423.392365:0:6932:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90ae06bcd800 10000000:01000000:2.0:1782727423.392408:0:6932:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782727423.392414:0:6932:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90ae0f4f0000 10000000:01000000:2.0:1782727423.392417:0:6932:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1782727423.392421:0:6932:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff90ae0f4f0000 from 1 10000000:01000000:2.0:1782727423.392424:0:6932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782727423.392471:0:6932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6000/0x8db73d43f5504790 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727423.392479:0:6932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6000/0x8db73d43f5504790 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727423.392491:0:6932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6000/0x8db73d43f5504790 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727423.392510:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100128256:0@lo:101: 00000100:00100000:2.0:1782727423.392573:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727423.392617:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e479600 going to sleep for 11 seconds 00000100:00100000:3.0:1782727423.392688:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100128256 00000100:00100000:3.0:1782727423.392695:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100128256 00000100:00100000:3.0:1782727423.392745:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782727423.392753:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+10:6932:x1869325100128256:12345-0@lo:101: 00010000:00010000:3.0:1782727423.392765:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727423.392780:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae01539000/0x8db73d43f5504797 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f5504790 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.392804:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae01539000/0x8db73d43f5504797 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f5504790 expref: 11 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.392814:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae01539000/0x8db73d43f5504797 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504790 expref: 11 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.392822:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae01539000, rc 0) 00000100:00100000:3.0:1782727423.392861:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+11:6932:x1869325100128256:12345-0@lo:101: Request processed in 109us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727423.392885:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782727423.392934:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100128256:0@lo:101: 00010000:00010000:3.0:1782727423.392947:0:6932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6000/0x8db73d43f5504790 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504797 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.392956:0:6932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6000/0x8db73d43f5504790 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f5504797 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727423.392973:0:6932:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782727423.392981:0:6932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6000/0x8db73d43f5504790 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504797 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.392988:0:6932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6000/0x8db73d43f5504790 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504797 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727423.392995:0:6932:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782727423.392998:0:6932:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782727423.393002:0:6932:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1782727423.393004:0:6932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782727423.393020:0:6932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f550479e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.393026:0:6932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f550479e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.393033:0:6932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f550479e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727423.393044:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100128384:0@lo:101: 00000100:00100000:3.0:1782727423.393067:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727423.393081:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b3f20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727423.393103:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100128384 00000100:00100000:3.0:1782727423.393107:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100128384 00000100:00100000:3.0:1782727423.393145:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782727423.393153:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+11:6932:x1869325100128384:12345-0@lo:101: 00010000:00010000:3.0:1782727423.393159:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727423.393167:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae01538600/0x8db73d43f55047a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f550479e expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.393179:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae01538600/0x8db73d43f55047a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f550479e expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.393188:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae01538600/0x8db73d43f55047a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f550479e expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.393193:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae01538600, rc 0) 00000100:00100000:3.0:1782727423.393218:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6932:x1869325100128384:12345-0@lo:101: Request processed in 67us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727423.393224:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782727423.393252:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100128384:0@lo:101: 00010000:00010000:3.0:1782727423.393262:0:6932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f550479e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55047a5 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.393269:0:6932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f550479e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f55047a5 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727423.393331:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100128512:0@lo:501: 00000100:00100000:3.0:1782727423.393356:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727423.393367:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b3f20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727423.393400:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100128512 00000100:00100000:3.0:1782727423.393409:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100128512 00000100:00100000:3.0:1782727423.393426:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782727423.393432:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6932:x1869325100128512:12345-0@lo:501: 00000100:00100000:3.0:1782727423.393546:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6932:x1869325100128512:12345-0@lo:501: Request processed in 114us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727423.393553:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782727423.393581:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100128512:0@lo:501: 00000100:00100000:3.0:1782727423.393617:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100128640:0@lo:503: 00000100:00100000:3.0:1782727423.393649:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727423.393661:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b3f20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727423.393672:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100128640 00000100:00100000:3.0:1782727423.393675:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100128640 00000100:00100000:3.0:1782727423.393690:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782727423.393695:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6932:x1869325100128640:12345-0@lo:503: 00000100:00100000:3.0:1782727423.393763:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6932:x1869325100128640:12345-0@lo:503: Request processed in 67us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727423.393769:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782727423.393808:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100128640:0@lo:503: 00000040:00080000:3.0:1782727423.394042:0:6932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782727423.394114:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100128768:0@lo:502: 00000100:00100000:3.0:1782727423.394146:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727423.394160:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b3f20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727423.394174:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100128768 00000100:00100000:3.0:1782727423.394178:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100128768 00000100:00100000:3.0:1782727423.394196:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782727423.394202:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6932:x1869325100128768:12345-0@lo:502: 00000100:00100000:3.0:1782727423.394276:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6932:x1869325100128768:12345-0@lo:502: Request processed in 73us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727423.394283:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782727423.394317:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100128768:0@lo:502: 00000040:00080000:3.0:1782727423.394550:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782727423.394574:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1782727423.394589:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1782727423.394602:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1782727423.394615:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1782727423.394627:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1782727423.394645:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100128896:0@lo:502: 00000100:00100000:3.0:1782727423.394674:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727423.394688:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b3f20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727423.394700:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100128896 00000100:00100000:3.0:1782727423.394704:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100128896 00000100:00100000:3.0:1782727423.394721:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782727423.394726:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6932:x1869325100128896:12345-0@lo:502: 00000100:00100000:3.0:1782727423.394783:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6932:x1869325100128896:12345-0@lo:502: Request processed in 55us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727423.394790:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782727423.394824:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100128896:0@lo:502: 00000040:00080000:3.0:1782727423.394855:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1782727423.394862:0:6932:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00010000:00010000:0.0:1782727423.395851:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727423.396184:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae01538200/0x8db73d43f5504782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8db73d43f5504789 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727423.396199:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01538200 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:0.0:1782727423.396205:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae01538200/0x8db73d43f5504782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8db73d43f5504789 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727423.396216:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae01538200/0x8db73d43f5504782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x8db73d43f5504789 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727423.396224:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae01538200/0x8db73d43f5504782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x8db73d43f5504789 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727423.396229:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727423.396264:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae01538200/0x8db73d43f5504782 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8db73d43f5504789 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727423.396272:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782727423.396326:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100129024:0@lo:103: 00000100:00100000:1.0:1782727423.396417:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782727423.396713:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae01538200/0x8db73d43f5504782 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8db73d43f5504789 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727423.396723:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae01538200/0x8db73d43f5504782 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8db73d43f5504789 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727423.396737:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727423.396739:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727423.396741:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727423.396965:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100129024 00000100:00100000:1.0:1782727423.396971:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100129024 00000100:00100000:1.0:1782727423.397058:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727423.397068:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:3445:x1869325100129024:12345-0@lo:103: 00010000:00010000:1.0:1782727423.397081:0:5939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727423.397096:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504789 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8db73d43f5504782 expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.397109:0:5939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727423.397189:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0332f07-5c7b-4a87-aafc-b3671573fb48+11:3445:x1869325100129024:12345-0@lo:103: Request processed in 121us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727423.397197:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727423.397257:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100129024:0@lo:103: 00000020:01000000:2.0:1782727423.397514:0:6954:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782727423.397524:0:6954:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1782727423.397531:0:6954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727423.397533:0:6954:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1782727423.397539:0:6954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782727423.397561:0:6954:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90ae3d8933a0) 00000020:00000080:2.0:1782727423.397581:0:6954:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1782727423.397588:0:6954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782727423.397666:0:6954:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90ae06bcd800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1782727423.397675:0:6954:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782727423.397687:0:6954:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8db73d43f55047b3 00010000:00010000:3.0:1782727423.403258:0:6954:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1782727423.403754:0:6954:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1782727423.411948:0:6954:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1782727423.413870:0:6954:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1782727423.425925:0:6954:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1782727423.426113:0:6954:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1782727423.436863:0:6954:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1782727423.439293:0:6954:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1782727423.439706:0:6954:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727423.439715:0:6954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727423.439717:0:6954:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1782727423.439720:0:6954:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727423.439726:0:6954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727423.439728:0:6954:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782727423.439733:0:6954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782727423.439735:0:6954:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1782727423.439759:0:6954:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727423.439763:0:6954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727423.439765:0:6954:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782727423.439769:0:6954:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1782727423.443297:0:6932:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1782727423.443345:0:6932:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782727423.443532:0:6932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f550479e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55047a5 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.443547:0:6932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f550479e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55047a5 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727423.443557:0:6932:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff90ae06bcd800 from 1 10000000:01000000:1.0:1782727423.443560:0:6932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782727423.443602:0:6932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae013a1200/0x8db73d43f55047ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.443610:0:6932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae013a1200/0x8db73d43f55047ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.443620:0:6932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae013a1200/0x8db73d43f55047ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727423.443643:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100129152:0@lo:101: 00000100:00100000:1.0:1782727423.443729:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727423.443781:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae063116c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727423.444232:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100129152 00000100:00100000:0.0:1782727423.444248:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100129152 00000100:00100000:0.0:1782727423.444317:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782727423.444328:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+11:6932:x1869325100129152:12345-0@lo:101: 00010000:00010000:0.0:1782727423.444343:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727423.444358:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae00031c00/0x8db73d43f55047c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f55047ba expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727423.444413:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae00031c00/0x8db73d43f55047c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f55047ba expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727423.444425:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae00031c00/0x8db73d43f55047c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55047ba expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727423.444434:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae00031c00, rc 0) 00000100:00100000:0.0:1782727423.444498:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6932:x1869325100129152:12345-0@lo:101: Request processed in 171us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727423.444506:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782727423.445621:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100129152:0@lo:101: 00010000:00010000:1.0:1782727423.445658:0:6932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae013a1200/0x8db73d43f55047ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55047c1 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.445671:0:6932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae013a1200/0x8db73d43f55047ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f55047c1 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727423.445806:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100129280:0@lo:501: 00000100:00100000:1.0:1782727423.445856:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727423.445894:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae063116c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727423.446665:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100129280 00000100:00100000:0.0:1782727423.446674:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100129280 00000100:00100000:0.0:1782727423.446721:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782727423.446731:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6932:x1869325100129280:12345-0@lo:501: 00000100:00100000:0.0:1782727423.446874:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6932:x1869325100129280:12345-0@lo:501: Request processed in 143us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727423.446881:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782727423.447055:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100129280:0@lo:501: 00000100:00100000:1.0:1782727423.447095:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100129408:0@lo:503: 00000100:00100000:1.0:1782727423.447217:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727423.447251:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae063116c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727423.447308:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100129408 00000100:00100000:0.0:1782727423.447314:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100129408 00000100:00100000:0.0:1782727423.447343:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782727423.447349:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6932:x1869325100129408:12345-0@lo:503: 00000100:00100000:0.0:1782727423.447457:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6932:x1869325100129408:12345-0@lo:503: Request processed in 107us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727423.447479:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782727423.447532:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100129408:0@lo:503: 00000040:00080000:0.0:1782727423.447883:0:6932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782727423.447959:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100129536:0@lo:502: 00000100:00100000:0.0:1782727423.447993:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727423.448023:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae08cfe240 going to sleep for 11 seconds 00000100:00100000:1.0:1782727423.448280:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100129536 00000100:00100000:1.0:1782727423.448297:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100129536 00000100:00100000:1.0:1782727423.448328:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782727423.448336:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6932:x1869325100129536:12345-0@lo:502: 00000100:00100000:1.0:1782727423.448444:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6932:x1869325100129536:12345-0@lo:502: Request processed in 109us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727423.448451:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782727423.448791:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100129536:0@lo:502: 00000040:00080000:0.0:1782727423.448991:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1782727423.449017:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1782727423.449038:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100129664:0@lo:502: 00000100:00100000:0.0:1782727423.449074:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727423.449094:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae081d1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782727423.449207:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100129664 00000100:00100000:1.0:1782727423.449212:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100129664 00000100:00100000:1.0:1782727423.449243:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782727423.449249:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6932:x1869325100129664:12345-0@lo:502: 00000100:00100000:1.0:1782727423.449323:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6932:x1869325100129664:12345-0@lo:502: Request processed in 73us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727423.449329:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782727423.449411:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100129664:0@lo:502: 00000040:00080000:2.0:1782727423.449448:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1782727423.449454:0:6932:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1782727423.453362:0:6958:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727423.453509:0:6958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727423.453512:0:6958:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782727423.453519:0:6958:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff90ae06bcd800 00000020:00000080:1.0:1782727423.453527:0:6958:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782727423.453541:0:6958:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727423.453544:0:6958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727423.453545:0:6958:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1782727423.453548:0:6958:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1782727423.453850:0:6932:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1782727423.454018:0:6932:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782727423.454076:0:6932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae013a1200/0x8db73d43f55047ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55047c1 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727423.454090:0:6932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae013a1200/0x8db73d43f55047ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55047c1 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727423.454158:0:6932:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782727423.454162:0:6932:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90ae06bcd800 10000000:01000000:2.0:1782727423.454165:0:6932:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90ae06bcd800 10000000:01000000:2.0:1782727423.454169:0:6932:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782727423.454175:0:6932:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff90ae06bcd800 from 1 10000000:01000000:2.0:1782727423.454178:0:6932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782727423.454216:0:6932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6400/0x8db73d43f55047c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727423.454224:0:6932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6400/0x8db73d43f55047c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727423.454235:0:6932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6400/0x8db73d43f55047c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727423.454258:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100129792:0@lo:101: 00000100:00100000:2.0:1782727423.454345:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727423.454422:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e4793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727423.454684:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100129792 00000100:00100000:3.0:1782727423.454692:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100129792 00000100:00100000:3.0:1782727423.454741:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782727423.454751:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:6932:x1869325100129792:12345-0@lo:101: 00010000:00010000:3.0:1782727423.454764:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727423.454778:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae01538400/0x8db73d43f55047cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f55047c8 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.454803:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae01538400/0x8db73d43f55047cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f55047c8 expref: 13 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.454813:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae01538400/0x8db73d43f55047cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55047c8 expref: 13 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.454823:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae01538400, rc 0) 00000100:00100000:3.0:1782727423.454865:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:6932:x1869325100129792:12345-0@lo:101: Request processed in 116us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727423.454878:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782727423.455332:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100129792:0@lo:101: 00010000:00010000:2.0:1782727423.455348:0:6932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6400/0x8db73d43f55047c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55047cf expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727423.455359:0:6932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6400/0x8db73d43f55047c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f55047cf expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727423.455483:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100129920:0@lo:501: 00000100:00100000:2.0:1782727423.455514:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727423.455539:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e4793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727423.455665:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100129920 00000100:00100000:0.0:1782727423.455670:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100129920 00000100:00100000:0.0:1782727423.455708:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782727423.455726:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:6932:x1869325100129920:12345-0@lo:501: 00000100:00100000:0.0:1782727423.456455:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:6932:x1869325100129920:12345-0@lo:501: Request processed in 727us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727423.456475:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782727423.456570:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100129920:0@lo:501: 00000100:00100000:2.0:1782727423.456602:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100130048:0@lo:503: 00000100:00100000:2.0:1782727423.456713:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727423.456742:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e4793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727423.457505:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100130048 00000100:00100000:3.0:1782727423.457514:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100130048 00000100:00100000:3.0:1782727423.457703:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782727423.457713:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:6932:x1869325100130048:12345-0@lo:503: 00000100:00100000:3.0:1782727423.457836:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:6932:x1869325100130048:12345-0@lo:503: Request processed in 124us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727423.457844:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782727423.458074:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100130048:0@lo:503: 00000040:00080000:2.0:1782727423.458779:0:6932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782727423.458862:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100130176:0@lo:502: 00000100:00100000:2.0:1782727423.458920:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727423.458962:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e4793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727423.459049:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100130176 00000100:00100000:0.0:1782727423.459056:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100130176 00000100:00100000:0.0:1782727423.459094:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782727423.459102:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:6932:x1869325100130176:12345-0@lo:502: 00000100:00100000:0.0:1782727423.459214:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:6932:x1869325100130176:12345-0@lo:502: Request processed in 112us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727423.459221:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782727423.460472:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100130176:0@lo:502: 00000040:00080000:2.0:1782727423.460848:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1782727423.460880:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1782727423.460895:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1782727423.460906:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1782727423.460928:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1782727423.460939:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1782727423.460953:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1782727423.460966:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1782727423.460995:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1782727423.461009:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1782727423.461021:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1782727423.461034:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1782727423.461050:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1782727423.461063:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1782727423.461078:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1782727423.461092:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1782727423.461106:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1782727423.461121:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1782727423.461135:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1782727423.461148:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1782727423.461162:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1782727423.461174:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1782727423.461184:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1782727423.461195:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1782727423.461221:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1782727423.461235:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1782727423.461249:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1782727423.461262:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1782727423.461297:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100130304:0@lo:502: 00000100:00100000:2.0:1782727423.462723:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727423.462763:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e4793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727423.462902:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100130304 00000100:00100000:3.0:1782727423.462911:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100130304 00000100:00100000:3.0:1782727423.462980:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782727423.462989:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:6932:x1869325100130304:12345-0@lo:502: 00000100:00100000:3.0:1782727423.463105:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:6932:x1869325100130304:12345-0@lo:502: Request processed in 117us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727423.463112:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782727423.463668:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100130304:0@lo:502: 00000040:00080000:2.0:1782727423.463741:0:6932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1782727423.463753:0:6932:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1782727423.467811:0:6959:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1782727423.467848:0:6959:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90ae3d890000) 00000020:00000080:2.0:1782727423.467871:0:6959:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1782727423.468220:0:6959:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90ae06bcd800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782727423.468225:0:6959:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90ae06bcd800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782727423.468227:0:6959:0:(obd_mount.c:701:lustre_put_lsi()) put ffff90ae06bcd800 3 00010000:00080000:2.0:1782727423.468258:0:6959:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90ae3b0a0800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1782727423.477591:0:6959:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1782727423.477706:0:6959:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1782727423.477752:0:6959:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782727423.477767:0:6959:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8db73d43f55047dd 00000100:00080000:2.0:1782727423.477779:0:6959:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782727423.477785:0:6959:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90ae3b0a0800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1782727423.477823:0:6959:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90ae3b0ec380 x1869325100130432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782727423.477850:0:6959:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1782727423.477959:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727423.477973:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325100130560:0@lo:400: 00000100:00100000:1.0:1782727423.478044:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727423.478206:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325100130432:0@lo:38: 00000100:00100000:0.0:1782727423.478243:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727423.478411:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100130560 00000100:00100000:2.0:1782727423.478418:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100130560 00000100:00100000:2.0:1782727423.478457:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100130432 00000100:00100000:2.0:1782727423.478468:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100130432 00000100:00100000:2.0:1782727423.478482:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727423.478489:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325100130560:12345-0@lo:400: 00000100:00100000:2.0:1782727423.478548:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325100130560:12345-0@lo:400: Request processed in 59us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727423.480419:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727423.480472:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727423.480479:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3442:x1869325100130432:12345-0@lo:38: 00010000:00080000:2.0:1782727423.480514:0:5953:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 147 last 0 00000020:00000080:2.0:1782727423.480680:0:5953:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8db73d43f55047e4 00000004:00100000:2.0:1782727423.480714:0:5953:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782727423.480766:0:5953:0:(import.c:65:import_set_state_nolock()) ffff90ae37c92800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782727423.480867:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1869325100130432:12345-0@lo:38: Request processed in 386us (2622us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727423.480874:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1782727423.481138:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90ae3b0ec380 x1869325100130432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782727433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727423.481151:0:3442:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782727423.481160:0:3442:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1782727423.481167:0:3442:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782727423.481173:0:3442:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782727423.481175:0:3442:0:(import.c:65:import_set_state_nolock()) ffff90ae3b0a0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782727423.481182:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3442:1869325100130432:0@lo:38: 00000040:00080000:0.0:1782727423.482205:0:6959:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1782727423.482274:0:6932:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1782727423.482316:0:6932:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782727423.482332:0:6932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6400/0x8db73d43f55047c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55047cf expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727423.482344:0:6932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6400/0x8db73d43f55047c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55047cf expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782727423.482414:0:6932:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1782727423.482417:0:6932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782727423.482418:0:6932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727423.482420:0:6932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727423.482421:0:6932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727423.482423:0:6932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727423.482424:0:6932:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782727423.482426:0:6932:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727423.482427:0:6932:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727423.482429:0:6932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727423.482430:0:6932:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782727423.482434:0:6932:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1782727423.482442:0:6932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782727423.482443:0:6932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782727423.482444:0:6932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727423.482445:0:6932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727423.482446:0:6932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727423.482447:0:6932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727423.482448:0:6932:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782727423.482449:0:6932:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727423.482450:0:6932:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727423.482450:0:6932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727423.482451:0:6932:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00080000:1.0:1782727423.482474:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90ae0354dc00 x1869325100130560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727423.482488:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325100130560:0@lo:400: 10000000:01000000:0.0:1782727423.485352:0:6932:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1782727423.485411:0:6932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100130688:0@lo:253: 00000100:00100000:0.0:1782727423.485535:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727423.485598:0:6932:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae081d1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782727423.485892:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100130688 00000100:00100000:3.0:1782727423.485900:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100130688 00000100:00100000:3.0:1782727423.486017:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782727423.486026:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:6932:x1869325100130688:12345-0@lo:253: 20000000:01000000:3.0:1782727423.486055:0:5946:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1782727423.486069:0:5946:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1782727423.494664:0:5946:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782727423.494686:0:5946:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1782727423.494708:0:5968:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782727423.494714:0:5968:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782727423.494738:0:5968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90ae0a3c7e00/0x8db73d43f55047eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727423.494759:0:5968:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae01539200/0x8db73d43f550474a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504743 expref: 13 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727423.494769:0:5968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90ae0a3c7e00/0x8db73d43f55047eb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727423.494812:0:5968:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae01539200/0x8db73d43f550474a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f5504743 expref: 13 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727423.494827:0:5968:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae01539200/0x8db73d43f550474a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f5504743 expref: 13 pid: 5947 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727423.494842:0:5968:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ef100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5968:1869325100130816:0@lo:104: 00000100:00100000:2.0:1782727423.494912:0:5968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727423.494962:0:5968:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e479180 going to sleep for 11 seconds 00000100:00100000:3.0:1782727423.495006:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:6932:x1869325100130688:12345-0@lo:253: Request processed in 8979us (9470us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727423.495017:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782727423.495181:0:6932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:6932:1869325100130688:0@lo:253: 10000000:01000000:0.0:1782727423.495192:0:6932:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1782727423.495196:0:6932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782727423.495198:0:6932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782727423.495199:0:6932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727423.495200:0:6932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727423.495202:0:6932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727423.495203:0:6932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727423.495205:0:6932:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782727423.495206:0:6932:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727423.495207:0:6932:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727423.495209:0:6932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727423.495210:0:6932:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1782727423.495225:0:6932:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1782727423.495522:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100130816 00000100:00100000:1.0:1782727423.495530:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100130816 00000100:00100000:1.0:1782727423.495576:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782727423.495584:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:5968:x1869325100130816:12345-0@lo:104: 00010000:00010000:1.0:1782727423.495597:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f550474a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.495660:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782727423.495665:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:5968:x1869325100130816:12345-0@lo:104: Request processed in 83us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727423.495672:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1782727423.495689:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727423.495695:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f550474a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.495703:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01539c00 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:1.0:1782727423.495707:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f550474a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.495734:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f550474a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727423.495742:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f550474a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727423.495748:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782727423.495775:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504743 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f550474a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.495782:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727423.495800:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504743 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f550474a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.495807:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504743 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f550474a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.495824:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727423.495825:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727423.495827:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727423.495841:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100130944:0@lo:103: 00000100:00100000:1.0:1782727423.495872:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727423.495904:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100130944 00000100:00100000:1.0:1782727423.495908:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100130944 00010000:00010000:1.0:1782727423.495922:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae01539200/0x8db73d43f550474a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f5504743 expref: 13 pid: 5947 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727423.495943:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782727423.495950:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3416f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:3443:x1869325100130944:12345-0@lo:103: 00010000:00010000:1.0:1782727423.495966:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727423.495971:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae01539200/0x8db73d43f550474a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f5504743 expref: 13 pid: 5947 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.495981:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae01539200/0x8db73d43f550474a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f5504743 expref: 13 pid: 5947 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.496010:0:5938:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90ae0a3c7e00/0x8db73d43f55047eb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.496018:0:5938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae0a3c7e00/0x8db73d43f55047eb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782727423.496032:0:5938:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002135821s 00010000:00010000:1.0:1782727423.496036:0:5938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ae0a3c7e00/0x8db73d43f55047eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.496044:0:5938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ae0a3c7e00/0x8db73d43f55047eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.496051:0:5938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90ae0a3c7e00/0x8db73d43f55047eb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.496058:0:5938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90ae0a3c7e00/0x8db73d43f55047eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.496063:0:5938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae0a3c7e00 already unused, calling callback (ffffffffc0b2bcf0) 00010000:00010000:1.0:1782727423.496067:0:5938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90ae0a3c7e00/0x8db73d43f55047eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.496074:0:5938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90ae0a3c7e00/0x8db73d43f55047eb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.496088:0:5938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90ae0a3c7e00/0x8db73d43f55047eb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727423.496097:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727423.496122:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3416f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:3443:x1869325100130944:12345-0@lo:103: Request processed in 173us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727423.496129:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782727423.496190:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100130944:0@lo:103: 00080000:10000000:0.0:1782727423.505189:0:6932:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00010000:00010000:3.0:1782727423.505481:0:5968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae01539200/0x8db73d43f550474a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f5504743 expref: 12 pid: 5947 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727423.505576:0:5968:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ef100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5968:1869325100130816:0@lo:104: 00010000:00010000:3.0:1782727423.505603:0:5968:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90ae0a3c7e00/0x8db73d43f55047eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.505613:0:5968:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90ae0a3c7e00/0x8db73d43f55047eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.505620:0:5968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90ae0a3c7e00/0x8db73d43f55047eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727423.505625:0:5968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae0a3c7e00/0x8db73d43f55047eb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1782727423.505905:0:6932:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1782727423.506141:0:6932:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1782727423.507279:0:6932:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1782727423.512908:0:6932:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1782727423.517091:0:6932:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1782727423.519605:0:6932:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1782727423.544360:0:6932:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1782727423.544369:0:6932:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1782727423.544471:0:6932:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782727423.544525:0:6932:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782727423.544544:0:6932:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1782727423.544566:0:6932:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1782727423.545300:0:6932:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727423.545498:0:6932:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1782727424.037905:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782727424.471685:0:7013:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727424.471935:0:7013:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782727425.061908:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727426.087233:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727427.113251:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727428.133916:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727428.774716:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782727428.774740:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100131072:0@lo:400: 00000100:00100000:1.0:1782727428.774825:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727428.774892:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325100131200:0@lo:400: 00000100:00100000:1.0:1782727428.774922:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727428.774940:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727428.774946:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325100131328:0@lo:400: 00000100:00100000:1.0:1782727428.774973:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727428.775002:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100131072 00000100:00100000:1.0:1782727428.775025:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100131072 00000100:00100000:1.0:1782727428.775074:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782727428.775082:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:3443:x1869325100131072:12345-0@lo:400: 00000100:00100000:1.0:1782727428.775131:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:3443:x1869325100131072:12345-0@lo:400: Request processed in 49us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727428.775138:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782727428.775192:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100131072:0@lo:400: 00000100:00100000:2.0:1782727428.777564:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100131200 00000100:00100000:2.0:1782727428.777577:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100131200 00000100:00100000:2.0:1782727428.777736:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100131328 00000100:00100000:2.0:1782727428.777742:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100131328 00000100:00100000:2.0:1782727428.777779:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782727428.777788:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325100131200:12345-0@lo:400: 00000100:00100000:2.0:1782727428.777896:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325100131200:12345-0@lo:400: Request processed in 109us (2972us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727428.777903:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782727428.777922:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782727428.777928:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325100131328:12345-0@lo:400: 00000100:00100000:2.0:1782727428.777958:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325100131328:12345-0@lo:400: Request processed in 31us (2985us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727428.777964:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1782727428.777997:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782727428.778132:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae0354f100 x1869325100131328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727428.778147:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325100131328:0@lo:400: 00010000:00080000:2.0:1782727428.778166:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae0354c000 x1869325100131200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727428.778174:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325100131200:0@lo:400: 00010000:00010000:3.0:1782727429.158546:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727429.769809:0:7303:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782727430.188221:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782727430.310839:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782727430.310848:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff90ae052c9800 from 21 10000000:01000000:2.0:1782727430.310855:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782727430.310896:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f55047f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727430.310908:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f55047f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727430.310919:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f55047f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727430.310952:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100131456:0@lo:101: 00000100:00100000:2.0:1782727430.311026:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727430.311114:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae07d5e180 going to sleep for 11 seconds 00000100:00100000:3.0:1782727430.311337:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100131456 00000100:00100000:3.0:1782727430.311345:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100131456 00000100:00100000:3.0:1782727430.311531:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782727430.311553:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5949:x1869325100131456:12345-0@lo:101: 00010000:00010000:3.0:1782727430.311567:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727430.311580:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae01538000/0x8db73d43f55047f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f55047f2 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727430.311604:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae01538000/0x8db73d43f55047f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f55047f2 expref: 13 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727430.311630:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae01538000/0x8db73d43f55047f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55047f2 expref: 13 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727430.311639:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae01538000, rc 0) 00000100:00100000:3.0:1782727430.311701:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:5949:x1869325100131456:12345-0@lo:101: Request processed in 150us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727430.311708:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782727430.311781:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100131456:0@lo:101: 00010000:00010000:0.0:1782727430.311797:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f55047f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55047f9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727430.311807:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f55047f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f55047f9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727430.311869:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100131584:0@lo:501: 00000100:00100000:0.0:1782727430.311898:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727430.312099:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0843a480 going to sleep for 11 seconds 00000100:00100000:2.0:1782727430.312131:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100131584 00000100:00100000:2.0:1782727430.312135:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100131584 00000100:00100000:2.0:1782727430.312161:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782727430.312167:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:5949:x1869325100131584:12345-0@lo:501: 00000100:00100000:2.0:1782727430.312464:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:5949:x1869325100131584:12345-0@lo:501: Request processed in 295us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727430.312472:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782727430.312746:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100131584:0@lo:501: 00000100:00100000:0.0:1782727430.312782:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100131712:0@lo:503: 00000100:00100000:0.0:1782727430.312822:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727430.312889:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0843a480 going to sleep for 11 seconds 00000100:00100000:2.0:1782727430.312918:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100131712 00000100:00100000:2.0:1782727430.312923:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100131712 00000100:00100000:2.0:1782727430.312979:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782727430.312985:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:5949:x1869325100131712:12345-0@lo:503: 00000100:00100000:2.0:1782727430.313076:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:5949:x1869325100131712:12345-0@lo:503: Request processed in 90us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727430.313083:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782727430.313145:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100131712:0@lo:503: 00000100:00100000:0.0:1782727430.313409:0:7329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:7329:1869325100131840:0@lo:502: 00000100:00100000:0.0:1782727430.313443:0:7329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727430.314019:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100131840 00000100:00100000:3.0:1782727430.314025:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100131840 00000100:00100000:3.0:1782727430.314055:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782727430.314062:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:7329:x1869325100131840:12345-0@lo:502: 00000100:00100000:3.0:1782727430.314150:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:7329:x1869325100131840:12345-0@lo:502: Request processed in 88us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727430.314158:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782727430.314487:0:7329:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0843a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727430.314508:0:7329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:7329:1869325100131840:0@lo:502: 00000100:00100000:0.0:1782727430.314627:0:7329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:7329:1869325100131968:0@lo:502: 00000100:00100000:0.0:1782727430.314733:0:7329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727430.314787:0:7329:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0843a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727430.314817:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100131968 00000100:00100000:3.0:1782727430.314821:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100131968 00000100:00100000:3.0:1782727430.314875:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782727430.314883:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:7329:x1869325100131968:12345-0@lo:502: 00000100:00100000:3.0:1782727430.314964:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:7329:x1869325100131968:12345-0@lo:502: Request processed in 81us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727430.314972:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782727430.315028:0:7329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:7329:1869325100131968:0@lo:502: 00000040:00080000:0.0:1782727430.315048:0:7329:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1782727430.315118:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1782727430.315137:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782727430.315147:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f55047f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55047f9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727430.315158:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f55047f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55047f9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727430.315166:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782727430.315169:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff90ae052c9800 from 4 10000000:01000000:0.0:1782727430.315172:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782727430.315209:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae00030800/0x8db73d43f5504800 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727430.315218:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae00030800/0x8db73d43f5504800 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727430.315227:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae00030800/0x8db73d43f5504800 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727430.315240:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100132096:0@lo:101: 00000100:00100000:0.0:1782727430.315274:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727430.315545:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0843a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727430.315572:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100132096 00000100:00100000:2.0:1782727430.315577:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100132096 00000100:00100000:2.0:1782727430.315602:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782727430.315609:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:5949:x1869325100132096:12345-0@lo:101: 00010000:00010000:2.0:1782727430.315617:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727430.315633:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae0a3c7600/0x8db73d43f5504807 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f5504800 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727430.315664:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae0a3c7600/0x8db73d43f5504807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f5504800 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727430.315681:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae0a3c7600/0x8db73d43f5504807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504800 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727430.315690:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae0a3c7600, rc 0) 00000100:00100000:2.0:1782727430.315728:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:5949:x1869325100132096:12345-0@lo:101: Request processed in 119us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727430.315734:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782727430.315773:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100132096:0@lo:101: 00010000:00010000:2.0:1782727430.315786:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae00030800/0x8db73d43f5504800 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504807 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727430.315794:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae00030800/0x8db73d43f5504800 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f5504807 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727430.315838:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100132224:0@lo:256: 00000100:00100000:2.0:1782727430.315872:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727430.315888:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b2bab40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727430.315901:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100132224 00000100:00100000:2.0:1782727430.315904:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100132224 00000100:00100000:2.0:1782727430.315925:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782727430.315932:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:5949:x1869325100132224:12345-0@lo:256: 20000000:01000000:2.0:1782727430.315945:0:5944:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782727430.315963:0:5944:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782727430.315966:0:5944:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1782727430.316033:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:5949:x1869325100132224:12345-0@lo:256: Request processed in 103us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727430.316040:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782727430.316090:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100132224:0@lo:256: 10000000:01000000:2.0:1782727430.316127:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782727430.316132:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae00030800/0x8db73d43f5504800 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504807 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727430.316140:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae00030800/0x8db73d43f5504800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504807 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727430.316147:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782727430.316149:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1782727430.316151:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782727430.316164:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6c00/0x8db73d43f550480e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727430.316170:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6c00/0x8db73d43f550480e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727430.316177:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6c00/0x8db73d43f550480e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727430.316187:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100132352:0@lo:101: 00000100:00100000:2.0:1782727430.316222:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727430.316234:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b2bab40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727430.316244:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100132352 00000100:00100000:2.0:1782727430.316247:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100132352 00000100:00100000:2.0:1782727430.316263:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782727430.316281:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:5949:x1869325100132352:12345-0@lo:101: 00010000:00010000:2.0:1782727430.316287:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727430.316294:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae0a3c6600/0x8db73d43f5504815 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f550480e expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727430.316316:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae0a3c6600/0x8db73d43f5504815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f550480e expref: 15 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727430.316333:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae0a3c6600/0x8db73d43f5504815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f550480e expref: 15 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727430.316340:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae0a3c6600, rc 0) 00000100:00100000:2.0:1782727430.316368:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:5949:x1869325100132352:12345-0@lo:101: Request processed in 88us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727430.316395:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782727430.316423:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100132352:0@lo:101: 00010000:00010000:2.0:1782727430.316433:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6c00/0x8db73d43f550480e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504815 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727430.316441:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6c00/0x8db73d43f550480e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f5504815 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727430.316487:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100132480:0@lo:501: 00000100:00100000:2.0:1782727430.316509:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727430.316522:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e479c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782727430.316533:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100132480 00000100:00100000:2.0:1782727430.316536:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100132480 00000100:00100000:2.0:1782727430.316552:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782727430.316558:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:5949:x1869325100132480:12345-0@lo:501: 00000100:00100000:2.0:1782727430.316653:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:5949:x1869325100132480:12345-0@lo:501: Request processed in 94us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727430.316658:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782727430.316692:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100132480:0@lo:501: 00000100:00100000:2.0:1782727430.316719:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100132608:0@lo:503: 00000100:00100000:2.0:1782727430.316754:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727430.316766:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e479c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782727430.316777:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100132608 00000100:00100000:2.0:1782727430.316779:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100132608 00000100:00100000:2.0:1782727430.316796:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782727430.316802:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:5949:x1869325100132608:12345-0@lo:503: 00000100:00100000:2.0:1782727430.316875:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:5949:x1869325100132608:12345-0@lo:503: Request processed in 73us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727430.316881:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782727430.316917:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100132608:0@lo:503: 00000100:00100000:2.0:1782727430.317132:0:7330:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:7330:1869325100132736:0@lo:502: 00000100:00100000:2.0:1782727430.317165:0:7330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727430.317185:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100132736 00000100:00100000:2.0:1782727430.317189:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100132736 00000100:00100000:2.0:1782727430.317208:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1782727430.317215:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:7330:x1869325100132736:12345-0@lo:502: 00000100:00100000:2.0:1782727430.317288:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:7330:x1869325100132736:12345-0@lo:502: Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727430.317296:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1782727430.317342:0:7330:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae091c3540 going to sleep for 11 seconds 00000100:00100000:2.0:1782727430.317354:0:7330:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:7330:1869325100132736:0@lo:502: 00000020:01000000:2.0:1782727430.317397:0:7330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782727430.317405:0:7330:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1782727430.317412:0:7330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727430.317419:0:7330:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1782727430.317425:0:7330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782727430.317429:0:7330:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:2.0:1782727430.317451:0:7330:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1782727430.317455:0:7330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782727430.317467:0:7330:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90ae3d894d70) 00000020:00000080:2.0:1782727430.317486:0:7330:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1782727430.317491:0:7330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782727430.317568:0:7330:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1782727430.317575:0:7330:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1782727430.317584:0:7330:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8db73d43f5504823 00010000:00080000:2.0:1782727430.317616:0:7330:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90ae37c94800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1782727430.317893:0:7330:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1782727430.329405:0:7330:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1782727430.329427:0:7330:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1782727430.331279:0:7330:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782727430.332446:0:7330:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782727430.332864:0:7330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1782727430.332960:0:7330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1782727430.334102:0:7332:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782727430.334109:0:7332:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1782727430.338452:0:7330:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782727430.338467:0:7330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1782727430.338526:0:7330:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1782727430.338550:0:7330:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8db73d43f550482a 00000100:00080000:3.0:1782727430.338561:0:7330:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782727430.338569:0:7330:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90ae37c94800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1782727430.338614:0:7330:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90ae035bf480 x1869325100132864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782727430.338638:0:7330:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1782727430.338712:0:7330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727430.338717:0:7330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727430.338719:0:7330:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1782727430.338722:0:7330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727430.338727:0:7330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727430.338728:0:7330:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782727430.338731:0:7330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782727430.338733:0:7330:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1782727430.338762:0:7330:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:7330:1869325100132992:0@lo:502: 00000100:00100000:3.0:1782727430.338850:0:7330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727430.338906:0:7330:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae10fff240 going to sleep for 11 seconds 00000100:00100000:1.0:1782727430.339282:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325100133248:0@lo:400: 00000100:00100000:1.0:1782727430.339317:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727430.339350:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727430.339356:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325100133120:0@lo:400: 00000100:00100000:1.0:1782727430.339393:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727430.339424:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100133248 00000100:00100000:1.0:1782727430.339430:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100133248 00000100:00100000:1.0:1782727430.339475:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100133120 00000100:00100000:1.0:1782727430.339478:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100133120 00000100:00100000:1.0:1782727430.339495:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782727430.339503:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325100133248:12345-0@lo:400: 00000100:00100000:1.0:1782727430.339567:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325100133248:12345-0@lo:400: Request processed in 64us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727430.339574:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782727430.339590:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782727430.339595:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325100133120:12345-0@lo:400: 00000100:00100000:1.0:1782727430.339621:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325100133120:12345-0@lo:400: Request processed in 26us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727430.339627:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1782727430.339773:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae0354dc00 x1869325100133120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727430.339786:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325100133120:0@lo:400: 00010000:00080000:1.0:1782727430.339795:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae0354e680 x1869325100133248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727430.339804:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325100133248:0@lo:400: 00000100:00100000:0.0:1782727430.339992:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3442:1869325100132864:0@lo:8: 00000100:00100000:0.0:1782727430.340031:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727430.340290:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100132992 00000100:00100000:3.0:1782727430.340295:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100132992 00000100:00100000:3.0:1782727430.340335:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782727430.340342:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:7330:x1869325100132992:12345-0@lo:502: 00000100:00100000:3.0:1782727430.340479:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:7330:x1869325100132992:12345-0@lo:502: Request processed in 137us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727430.340486:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782727430.340634:0:7330:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:7330:1869325100132992:0@lo:502: 00000020:01000000:3.0:1782727430.340732:0:7330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727430.340739:0:7330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727430.340741:0:7330:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782727430.340745:0:7330:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1782727430.340942:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100132864 00000100:00100000:1.0:1782727430.340947:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100132864 00000100:00100000:1.0:1782727430.340974:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727430.340979:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3442:x1869325100132864:12345-0@lo:8: 00010000:00080000:1.0:1782727430.341000:0:6939:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:1.0:1782727430.341025:0:6939:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8db73d43f5504831 00002000:00100000:1.0:1782727430.341063:0:6939:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90ae2f38c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1782727430.341067:0:6939:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1782727430.341071:0:6939:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1782727430.341126:0:6939:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1782727430.341361:0:6939:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782727430.341405:0:6939:0:(import.c:65:import_set_state_nolock()) ffff90ae2f38f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782727430.341460:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3442:x1869325100132864:12345-0@lo:8: Request processed in 480us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727430.341467:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782727430.341506:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae035bf480 x1869325100132864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782727440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727430.341529:0:3442:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782727430.341535:0:3442:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1782727430.341542:0:3442:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1782727430.341553:0:3442:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1782727430.341556:0:3442:0:(import.c:65:import_set_state_nolock()) ffff90ae37c94800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1782727430.341569:0:3442:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1782727430.341574:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3442:1869325100132864:0@lo:8: 00000100:00080000:2.0:1782727430.341822:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:2.0:1782727430.341848:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1782727430.341876:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782727430.341886:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6c00/0x8db73d43f550480e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504815 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727430.341896:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6c00/0x8db73d43f550480e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504815 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727430.341906:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1782727430.341908:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff90ae0f4f0000 from 1 10000000:01000000:2.0:1782727430.341911:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782727430.341945:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7e00/0x8db73d43f5504838 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727430.341953:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7e00/0x8db73d43f5504838 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727430.341962:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7e00/0x8db73d43f5504838 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727430.341978:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100133376:0@lo:101: 00000100:00100000:2.0:1782727430.342016:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727430.342053:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae091c3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782727430.343199:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100133376 00000100:00100000:1.0:1782727430.343211:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100133376 00000100:00100000:1.0:1782727430.343265:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782727430.343275:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:5949:x1869325100133376:12345-0@lo:101: 00010000:00010000:1.0:1782727430.343288:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727430.343305:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae013a0a00/0x8db73d43f550483f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f5504838 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727430.343342:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae013a0a00/0x8db73d43f550483f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f5504838 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727430.343353:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae013a0a00/0x8db73d43f550483f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504838 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727430.343361:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae013a0a00, rc 0) 00000100:00100000:1.0:1782727430.343452:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:5949:x1869325100133376:12345-0@lo:101: Request processed in 178us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727430.343458:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782727430.343598:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100133376:0@lo:101: 00010000:00010000:2.0:1782727430.343617:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7e00/0x8db73d43f5504838 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550483f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727430.343627:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7e00/0x8db73d43f5504838 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f550483f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727430.343770:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100133504:0@lo:501: 00000100:00100000:2.0:1782727430.343804:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727430.343832:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae091c3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782727430.345046:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100133504 00000100:00100000:3.0:1782727430.345055:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100133504 00000100:00100000:3.0:1782727430.345102:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782727430.345126:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:5949:x1869325100133504:12345-0@lo:501: 00000100:00100000:3.0:1782727430.345242:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:5949:x1869325100133504:12345-0@lo:501: Request processed in 118us (1438us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782727430.345250:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782727430.345299:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100133504:0@lo:501: 10000000:01000000:3.0:1782727430.345352:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782727430.345362:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7e00/0x8db73d43f5504838 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550483f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727430.345387:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7e00/0x8db73d43f5504838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550483f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782727430.347778:0:7332:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1782727430.347875:0:7332:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 154629502049ns, next at 0ns, rc = 0 00080000:00080000:0.0:1782727430.347884:0:7332:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1782727430.361736:0:7333:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1782727430.361774:0:7333:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7333:1869325100133760:0@lo:7: 00000100:00100000:0.0:1782727430.361855:0:7333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727430.361913:0:7333:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0843a000 going to sleep for 11 seconds 00000100:00100000:2.0:1782727430.362079:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100133632:0@lo:13: 00000100:00100000:2.0:1782727430.362117:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1782727430.362749:0:5931:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1782727430.362842:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100133760 00000100:00100000:1.0:1782727430.362850:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100133760 00000100:00100000:1.0:1782727430.362911:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782727430.363019:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7333:x1869325100133760:12345-0@lo:7: 00000100:00080000:3.0:1782727430.363165:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727430.366595:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100133632 00000100:00100000:3.0:1782727430.366608:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100133632 00000100:00100000:3.0:1782727430.366678:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727430.366690:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3445:x1869325100133632:12345-0@lo:13: 00002000:00000024:3.0:1782727430.366723:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923918848 avail 3692396544 00000100:00100000:3.0:1782727430.366826:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3445:x1869325100133632:12345-0@lo:13: Request processed in 139us (4708us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727430.366834:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782727430.367024:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae0f7d7b80 x1869325100133632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727430.367046:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100133632:0@lo:13: 00002000:00080000:1.0:1782727430.373832:0:6941:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1782727430.373842:0:6941:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1782727430.374104:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7333:x1869325100133760:12345-0@lo:7: Request processed in 11084us (12244us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727430.374122:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782727430.378195:0:7333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae0f7d5f80 x1869325100133760/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782727446 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727430.378217:0:7333:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7333:1869325100133760:0@lo:7: 00000004:00080000:0.0:1782727430.378234:0:7333:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1782727430.378278:0:7333:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7333:1869325100133888:0@lo:5: 00000100:00100000:0.0:1782727430.378352:0:7333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727430.378500:0:7333:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0843a000 going to sleep for 11 seconds 00000100:00100000:2.0:1782727430.381839:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100133888 00000100:00100000:2.0:1782727430.381857:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100133888 00000100:00100000:2.0:1782727430.381911:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727430.381933:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7333:x1869325100133888:12345-0@lo:5: 00002000:00080000:2.0:1782727430.381965:0:6940:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1782727430.381977:0:6940:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1782727430.385266:0:6933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1782727430.385291:0:6933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1782727430.385718:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7333:x1869325100133888:12345-0@lo:5: Request processed in 3782us (7361us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1782727430.385734:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1782727430.385794:0:7333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae0f7d5f80 x1869325100133888/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782727446 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727430.385807:0:7333:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1782727430.385814:0:7333:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7333:1869325100133888:0@lo:5: 00000004:00080000:0.0:1782727430.385833:0:7333:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1782727430.385888:0:7333:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7333:1869325100134016:0@lo:700: 00000100:00100000:0.0:1782727430.388029:0:7333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727430.388085:0:7333:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0843a000 going to sleep for 11 seconds 00000100:00100000:1.0:1782727430.388125:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100134016 00000100:00100000:1.0:1782727430.388134:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100134016 00000100:00100000:1.0:1782727430.388186:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727430.388195:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7333:x1869325100134016:12345-0@lo:700: 00000100:00100000:1.0:1782727430.388252:0:6947:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6947:1869325100134144:0@lo:700: 00000100:00100000:1.0:1782727430.388291:0:6947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727430.388336:0:6947:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae031fb300 going to sleep for 11 seconds 00000100:00100000:0.0:1782727430.389628:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100134144 00000100:00100000:0.0:1782727430.389639:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100134144 00000100:00100000:0.0:1782727430.389688:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782727430.389699:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6947:x1869325100134144:12345-0@lo:700: 40000000:02000000:2.0:1782727430.400078:0:5959:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00010000:00080000:2.0:1782727430.412627:0:6947:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae0354e680 x1869325100134144/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782727446 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727430.412645:0:6947:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6947:1869325100134144:0@lo:700: 40000000:02000000:2.0:1782727430.412672:0:6947:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1782727430.413160:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6947:x1869325100134144:12345-0@lo:700: Request processed in 23460us (24863us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727430.413177:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727430.444115:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7333:x1869325100134016:12345-0@lo:700: Request processed in 55911us (56083us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727430.444130:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782727430.444209:0:7333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae0f7d5f80 x1869325100134016/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782727446 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727430.444225:0:7333:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7333:1869325100134016:0@lo:700: 00000004:02000040:0.0:1782727430.455600:0:7333:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1782727430.462446:0:7333:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7333:1869325100134272:0@lo:5: 00000100:00100000:1.0:1782727430.462518:0:7333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727430.462577:0:7333:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae031fbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1782727430.464434:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100134272 00000100:00100000:2.0:1782727430.464444:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100134272 00000100:00100000:2.0:1782727430.464500:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782727430.464510:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7333:x1869325100134272:12345-0@lo:5: 00002000:00080000:3.0:1782727430.474939:0:6941:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1782727430.474965:0:6941:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1782727430.480534:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7333:x1869325100134272:12345-0@lo:5: Request processed in 16017us (18006us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1782727430.480562:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1782727430.485899:0:7333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae0354f100 x1869325100134272/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782727446 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727430.485923:0:7333:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7333:1869325100134272:0@lo:5: 00000004:00080000:1.0:1782727430.485943:0:7333:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000020:00000004:0.0:1782727430.635709:0:7359:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782727430.636423:0:7359:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782727431.207048:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782727431.359042:0:6933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1782727432.229758:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782727433.218979:0:7460:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782727433.219185:0:7460:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782727433.254720:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782727434.093809:0:7509:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782727434.093819:0:7509:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1782727434.281988:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727435.301484:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727435.431145:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782727435.431172:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100134400:0@lo:13: 00000100:00100000:2.0:1782727435.431275:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727435.431454:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100134400 00000100:00100000:3.0:1782727435.431462:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100134400 00000100:00080000:2.0:1782727435.431514:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727435.431532:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782727435.431542:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100134400:12345-0@lo:13: 00002000:00000024:3.0:1782727435.431572:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727435.431625:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100134400:12345-0@lo:13: Request processed in 85us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727435.431633:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782727435.432064:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae3b0ece00 x1869325100134400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727435.432075:0:3445:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1782727435.432096:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100134400:0@lo:13: 00000100:00100000:1.0:1782727435.436514:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100134528:0@lo:400: 00000100:00100000:1.0:1782727435.436591:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727435.436649:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100134528 00000100:00100000:1.0:1782727435.436655:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100134528 00000100:00100000:1.0:1782727435.436700:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782727435.436708:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f581c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:3443:x1869325100134528:12345-0@lo:400: 00000100:00100000:1.0:1782727435.436768:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f581c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:3443:x1869325100134528:12345-0@lo:400: Request processed in 60us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727435.436776:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782727435.436826:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100134528:0@lo:400: 00000100:00100000:0.0:1782727435.436870:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325100134656:0@lo:400: 00000100:00100000:0.0:1782727435.436904:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727435.437077:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100134656 00000100:00100000:1.0:1782727435.437081:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100134656 00000100:00100000:1.0:1782727435.437109:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782727435.437115:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325100134656:12345-0@lo:400: 00000100:00100000:1.0:1782727435.437154:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325100134656:12345-0@lo:400: Request processed in 38us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727435.437160:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1782727435.437189:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae3b0ee680 x1869325100134656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727435.437201:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325100134656:0@lo:400: 00000100:00100000:3.0:1782727435.437614:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782727435.437628:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3446:1869325100134784:0@lo:400: 00000100:00100000:3.0:1782727435.437664:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727435.437972:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100134784 00000100:00100000:0.0:1782727435.437978:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100134784 00000100:00100000:0.0:1782727435.438023:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782727435.438031:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869325100134784:12345-0@lo:400: 00000100:00100000:0.0:1782727435.438083:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869325100134784:12345-0@lo:400: Request processed in 53us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727435.438090:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1782727435.438136:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782727435.438156:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae3b0efb80 x1869325100134784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727435.438168:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3446:1869325100134784:0@lo:400: 00010000:00010000:2.0:1782727436.326542:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727437.351649:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727438.373478:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727439.405581:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727440.422650:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727440.550261:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100134912:0@lo:13: 00000100:00100000:0.0:1782727440.550423:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727440.550534:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100134912 00000100:00100000:0.0:1782727440.550542:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100134912 00000100:00100000:0.0:1782727440.550611:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782727440.550623:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100134912:12345-0@lo:13: 00002000:00000024:0.0:1782727440.550664:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727440.550714:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100134912:12345-0@lo:13: Request processed in 94us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727440.550722:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1782727440.550747:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782727440.550783:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae0f7d6300 x1869325100134912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727440.550802:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100134912:0@lo:13: 00000100:00100000:1.0:1782727440.551095:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325100135168:0@lo:400: 00000100:00100000:1.0:1782727440.551143:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727440.551165:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727440.551170:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0332f07-5c7b-4a87-aafc-b3671573fb48:3444:1869325100135040:0@lo:400: 00000100:00100000:1.0:1782727440.551199:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727440.551704:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100135168 00000100:00100000:1.0:1782727440.551712:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100135168 00000100:00100000:1.0:1782727440.551752:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782727440.551760:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325100135168:12345-0@lo:400: 00000100:00100000:1.0:1782727440.551813:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325100135168:12345-0@lo:400: Request processed in 53us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727440.551833:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782727440.551857:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100135040 00000100:00100000:1.0:1782727440.551861:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100135040 00000100:00100000:1.0:1782727440.551889:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782727440.551895:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:3444:x1869325100135040:12345-0@lo:400: 00000100:00100000:1.0:1782727440.551927:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:3444:x1869325100135040:12345-0@lo:400: Request processed in 32us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727440.551932:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782727440.551970:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0332f07-5c7b-4a87-aafc-b3671573fb48:3444:1869325100135040:0@lo:400: 00010000:00080000:1.0:1782727440.551983:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae0354f800 x1869325100135168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727440.551993:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325100135168:0@lo:400: 00000100:00100000:1.0:1782727440.552022:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325100135296:0@lo:400: 00000100:00100000:1.0:1782727440.552054:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727440.552086:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100135296 00000100:00100000:1.0:1782727440.552090:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100135296 00000100:00100000:1.0:1782727440.552120:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782727440.552140:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325100135296:12345-0@lo:400: 00000100:00100000:1.0:1782727440.552174:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325100135296:12345-0@lo:400: Request processed in 48us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727440.552181:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1782727440.552205:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae0354e300 x1869325100135296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727440.552217:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325100135296:0@lo:400: 00000100:00080000:0.0:1782727440.552428:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782727441.445641:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727442.469768:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782727442.875985:0:8007:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782727442.875990:0:8007:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1782727442.875996:0:8007:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1782727442.876160:0:8007:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff90ae3dae6000 00000020:01000004:2.0:1782727442.876178:0:8007:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1782727442.876194:0:8007:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1782727442.876213:0:8007:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90ae3d8919d0) 00000020:00000080:2.0:1782727442.876236:0:8007:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1782727442.917177:0:8007:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1782727442.917229:0:8007:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1782727442.944301:0:8007:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1782727442.944667:0:8007:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1782727442.944696:0:8007:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782727442.944714:0:8007:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8db73d43f550484d 00000020:01000004:3.0:1782727442.945046:0:8007:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1782727442.945087:0:8007:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.135@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782727442.945092:0:8007:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782727442.945100:0:8007:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1782727442.945150:0:8007:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1782727442.945155:0:8007:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1782727442.983976:0:8007:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782727442.984022:0:8007:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.135@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1782727442.984027:0:8007:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782727442.984029:0:8007:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782727442.984030:0:8007:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727442.984032:0:8007:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727442.984033:0:8007:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727442.984035:0:8007:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727442.984037:0:8007:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782727442.984038:0:8007:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727442.984039:0:8007:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727442.984041:0:8007:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727442.984043:0:8007:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782727442.984722:0:8007:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1782727442.984728:0:8007:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782727442.984729:0:8007:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782727442.984731:0:8007:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727442.984732:0:8007:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727442.984743:0:8007:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727442.984745:0:8007:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727442.984747:0:8007:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782727442.984748:0:8007:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727442.984749:0:8007:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727442.984750:0:8007:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727442.984751:0:8007:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782727442.984785:0:8007:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1782727442.985993:0:8007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100135424:0@lo:253: 00000100:00100000:1.0:1782727442.986161:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727442.986232:0:8007:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b3ce900 going to sleep for 11 seconds 00000100:00100000:3.0:1782727442.987011:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100135424 00000100:00100000:3.0:1782727442.987021:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100135424 00000100:00100000:3.0:1782727442.987090:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782727442.987102:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:8007:x1869325100135424:12345-0@lo:253: 20000000:01000000:3.0:1782727442.987138:0:5946:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1782727442.987143:0:5946:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1782727442.987148:0:5946:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1782727442.987152:0:5946:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1782727442.987474:0:5946:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782727442.989124:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1782727442.989150:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1782727442.989177:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1782727442.989185:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1782727442.989199:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1782727442.989215:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1782727442.989340:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1782727442.989358:0:5946:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.135@tcp 20000000:01000000:3.0:1782727442.989360:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.135@tcp (null) (null) (null) 00000040:00080000:3.0:1782727442.989405:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1782727442.989413:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1782727442.989429:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1782727442.989435:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.135@tcp (null) (null) 00000040:00080000:3.0:1782727442.989449:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1782727442.989456:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1782727442.989469:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1782727442.989507:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1782727442.989890:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1782727442.989904:0:5946:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.135@tcp 20000000:01000000:3.0:1782727442.989905:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.135@tcp (null) (null) (null) 00000040:00080000:3.0:1782727442.989929:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1782727442.989936:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1782727442.989948:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1782727442.989953:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.135@tcp (null) (null) 00000040:00080000:3.0:1782727442.989965:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1782727442.989971:0:5946:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1782727442.989983:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1782727442.989998:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1782727442.990011:0:5946:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1782727442.990014:0:5946:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1782727442.990018:0:5946:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1782727442.990061:0:5946:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782727442.990064:0:5946:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782727442.991142:0:8013:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1782727442.991192:0:8013:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1782727442.991214:0:8013:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1782727442.991969:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1782727442.991993:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1782727442.992006:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1782727442.992015:0:5946:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1782727442.992017:0:5946:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782727442.992583:0:8014:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1782727442.992605:0:8014:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1782727442.992623:0:8014:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1782727442.992885:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1782727442.992924:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1782727442.992940:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1782727442.992951:0:5946:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1782727442.992953:0:5946:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782727442.993951:0:8015:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1782727442.994002:0:8015:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1782727442.994015:0:8015:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1782727442.994449:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1782727442.994472:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1782727442.994489:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1782727442.994499:0:5946:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1782727442.994501:0:5946:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1782727442.997229:0:8016:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1782727442.997515:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1782727442.997709:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1782727442.997731:0:5946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:1.0:1782727442.997751:0:5946:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782727442.997773:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504854 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.997791:0:5946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae01538600/0x8db73d43f55047a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f550479e expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.997799:0:5946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae01538400/0x8db73d43f55047cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55047c8 expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.997807:0:5946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae01538000/0x8db73d43f55047f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55047f2 expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.997823:0:5946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae0a3c6600/0x8db73d43f5504815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f550480e expref: 16 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.997830:0:5946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae013a0a00/0x8db73d43f550483f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504838 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.997840:0:5946:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504854 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.997882:0:5946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae013a0a00/0x8db73d43f550483f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f5504838 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.997898:0:5946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae013a0a00/0x8db73d43f550483f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f5504838 expref: 16 pid: 5947 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727442.997914:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5946:1869325100135552:0@lo:104: 00000100:00100000:1.0:1782727442.997988:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782727442.998094:0:5946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae0a3c6600/0x8db73d43f5504815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f550480e expref: 16 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.998103:0:5946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae0a3c6600/0x8db73d43f5504815 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f550480e expref: 16 pid: 5944 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727442.998112:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5946:1869325100135680:0@lo:104: 00010000:00010000:1.0:1782727442.998139:0:5946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae01538000/0x8db73d43f55047f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f55047f2 expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.998147:0:5946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae01538000/0x8db73d43f55047f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f55047f2 expref: 16 pid: 5946 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727442.998167:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5946:1869325100135808:0@lo:104: 00010000:00010000:1.0:1782727442.998196:0:5946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae01538400/0x8db73d43f55047cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f55047c8 expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.998204:0:5946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae01538400/0x8db73d43f55047cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f55047c8 expref: 16 pid: 5946 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727442.998212:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5946:1869325100135936:0@lo:104: 00010000:00010000:1.0:1782727442.998238:0:5946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae01538600/0x8db73d43f55047a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f550479e expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727442.998246:0:5946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae01538600/0x8db73d43f55047a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f550479e expref: 16 pid: 5947 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727442.998253:0:5946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5946:1869325100136064:0@lo:104: 00000100:00100000:1.0:1782727442.998271:0:5946:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0548b540 going to sleep for 11 seconds 00000100:00100000:2.0:1782727443.002789:0:5936:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782727443.002852:0:5936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727443.002897:0:5936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727443.002908:0:5936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727443.002920:0:5936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727443.002935:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100135552 00000100:00100000:2.0:1782727443.002943:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100135552 00000100:00100000:2.0:1782727443.002985:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100135680 00000100:00100000:2.0:1782727443.002988:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100135680 00000100:00100000:2.0:1782727443.002999:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100135808 00000100:00100000:2.0:1782727443.003001:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100135808 00000100:00100000:2.0:1782727443.003020:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100135936 00000100:00100000:2.0:1782727443.003022:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100135936 00000100:00100000:2.0:1782727443.003031:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100136064 00000100:00100000:2.0:1782727443.003033:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100136064 00000100:00100000:2.0:1782727443.003055:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782727443.003065:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+7:5946:x1869325100135552:12345-0@lo:104: 00010000:00010000:2.0:1782727443.003137:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7e00/0x8db73d43f5504838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f550483f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.003276:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782727443.003284:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+7:5946:x1869325100135552:12345-0@lo:104: Request processed in 221us (5296us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727443.003291:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782727443.003341:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782727443.003363:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+6:5946:x1869325100135680:12345-0@lo:104: 00010000:00010000:2.0:1782727443.003395:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6c00/0x8db73d43f550480e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f5504815 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727443.003488:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5946:1869325100135552:0@lo:104: 00000100:00100000:1.0:1782727443.003498:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5946:1869325100135680:0@lo:104: 00010000:00010000:3.0:1782727443.003587:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782727443.003593:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7e00/0x8db73d43f5504838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f550483f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.003704:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae0a3c7e00 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:3.0:1782727443.003709:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7e00/0x8db73d43f5504838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f550483f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.003719:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7e00/0x8db73d43f5504838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f550483f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727443.003735:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7e00/0x8db73d43f5504838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f550483f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727443.003742:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727443.003787:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7e00/0x8db73d43f5504838 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f550483f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.003794:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782727443.003849:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100136192:0@lo:103: 00000100:00100000:1.0:1782727443.003889:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782727443.004004:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7e00/0x8db73d43f5504838 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f550483f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.004018:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7e00/0x8db73d43f5504838 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f550483f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.004031:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727443.004035:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6c00/0x8db73d43f550480e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f5504815 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.004041:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae0a3c6c00 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:3.0:1782727443.004044:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6c00/0x8db73d43f550480e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f5504815 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.004051:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6c00/0x8db73d43f550480e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f5504815 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727443.004058:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6c00/0x8db73d43f550480e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f5504815 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727443.004063:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727443.004107:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6c00/0x8db73d43f550480e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504815 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.004114:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727443.004129:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6c00/0x8db73d43f550480e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504815 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.004136:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6c00/0x8db73d43f550480e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504815 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.004146:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727443.004148:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727443.004150:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727443.004189:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1782727443.004195:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+6:5946:x1869325100135680:12345-0@lo:104: Request processed in 833us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727443.004203:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782727443.004221:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782727443.004227:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+5:5946:x1869325100135808:12345-0@lo:104: 00010000:00010000:2.0:1782727443.004235:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f55047f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f55047f9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.004274:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782727443.004280:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+5:5946:x1869325100135808:12345-0@lo:104: Request processed in 54us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727443.004285:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782727443.004297:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782727443.004304:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+4:5946:x1869325100135936:12345-0@lo:104: 00010000:00010000:2.0:1782727443.004311:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6400/0x8db73d43f55047c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f55047cf expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.004338:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782727443.004342:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+4:5946:x1869325100135936:12345-0@lo:104: Request processed in 40us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727443.004348:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782727443.004358:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782727443.004365:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:5946:x1869325100136064:12345-0@lo:104: 00010000:00010000:2.0:1782727443.004405:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f550479e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f55047a5 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.004434:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1782727443.004439:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:5946:x1869325100136064:12345-0@lo:104: Request processed in 75us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727443.004445:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1782727443.004461:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782727443.004465:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f55047f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f55047f9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.004471:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae0a3c7000 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:2.0:1782727443.004474:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f55047f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f55047f9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.004482:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f55047f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f55047f9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727443.004488:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f55047f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f55047f9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727443.004493:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782727443.004507:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f55047f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55047f9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.004513:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782727443.004519:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f55047f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55047f9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.004526:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f55047f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55047f9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.004542:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782727443.004545:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6400/0x8db73d43f55047c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f55047cf expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.004550:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae0a3c6400 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:2.0:1782727443.004553:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6400/0x8db73d43f55047c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f55047cf expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.004560:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6400/0x8db73d43f55047c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f55047cf expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727443.004566:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6400/0x8db73d43f55047c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f55047cf expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727443.004570:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782727443.004583:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6400/0x8db73d43f55047c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55047cf expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.004588:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727443.004656:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1782727443.004782:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782727443.004793:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100136576:0@lo:103: 00000100:00100000:1.0:1782727443.004836:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727443.004877:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100136192 00000100:00100000:1.0:1782727443.004883:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100136192 00010000:00010000:1.0:1782727443.004905:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae013a0a00/0x8db73d43f550483f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f5504838 expref: 17 pid: 5947 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727443.004931:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100136576 00000100:00100000:1.0:1782727443.004933:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100136576 00010000:00010000:1.0:1782727443.004942:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae01538400/0x8db73d43f55047cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55047c8 expref: 18 pid: 5946 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727443.004952:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782727443.004957:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:3446:x1869325100136192:12345-0@lo:103: 00010000:00010000:1.0:1782727443.004967:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727443.004972:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae013a0a00/0x8db73d43f550483f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f5504838 expref: 18 pid: 5947 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727443.004980:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae013a0a00/0x8db73d43f550483f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f5504838 expref: 18 pid: 5947 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727443.004993:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae013a0a00/0x8db73d43f550483f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f5504838 expref: 18 pid: 5947 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727443.005005:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727443.005033:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:3446:x1869325100136192:12345-0@lo:103: Request processed in 75us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727443.005040:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782727443.005051:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782727443.005056:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:3446:x1869325100136576:12345-0@lo:103: 00010000:00010000:1.0:1782727443.005062:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727443.005066:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae01538400/0x8db73d43f55047cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55047c8 expref: 16 pid: 5946 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727443.005074:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae01538400/0x8db73d43f55047cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f55047c8 expref: 16 pid: 5946 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727443.005101:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727443.005125:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:3446:x1869325100136576:12345-0@lo:103: Request processed in 69us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727443.005132:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782727443.005157:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0332f07-5c7b-4a87-aafc-b3671573fb48:3444:1869325100136448:0@lo:103: 00000100:00100000:1.0:1782727443.005180:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727443.005197:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727443.005203:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0332f07-5c7b-4a87-aafc-b3671573fb48:3444:1869325100136320:0@lo:103: 00000100:00100000:1.0:1782727443.005240:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727443.005277:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100136448 00000100:00100000:1.0:1782727443.005282:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100136448 00010000:00010000:1.0:1782727443.005296:0:5939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae01538000/0x8db73d43f55047f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55047f2 expref: 16 pid: 5946 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727443.005309:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100136320 00000100:00100000:1.0:1782727443.005311:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100136320 00010000:00010000:1.0:1782727443.005321:0:5939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae0a3c6600/0x8db73d43f5504815 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f550480e expref: 17 pid: 5944 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727443.005331:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782727443.005336:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:3444:x1869325100136448:12345-0@lo:103: 00010000:00010000:1.0:1782727443.005343:0:5939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727443.005347:0:5939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae01538000/0x8db73d43f55047f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55047f2 expref: 17 pid: 5946 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727443.005355:0:5939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae01538000/0x8db73d43f55047f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f55047f2 expref: 17 pid: 5946 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727443.005408:0:5939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727443.005439:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:3444:x1869325100136448:12345-0@lo:103: Request processed in 102us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727443.005446:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782727443.005459:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782727443.005465:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:3444:x1869325100136320:12345-0@lo:103: 00010000:00010000:1.0:1782727443.005474:0:5939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727443.005479:0:5939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae0a3c6600/0x8db73d43f5504815 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f550480e expref: 16 pid: 5944 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727443.005488:0:5939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae0a3c6600/0x8db73d43f5504815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f550480e expref: 16 pid: 5944 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727443.005500:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae0a3c6600/0x8db73d43f5504815 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f550480e expref: 16 pid: 5944 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727443.005510:0:5939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727443.005533:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:3444:x1869325100136320:12345-0@lo:103: Request processed in 68us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727443.005539:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782727443.005573:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0332f07-5c7b-4a87-aafc-b3671573fb48:3444:1869325100136320:0@lo:103: 00000100:00100000:1.0:1782727443.005582:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0332f07-5c7b-4a87-aafc-b3671573fb48:3444:1869325100136448:0@lo:103: 00000100:00100000:1.0:1782727443.005607:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100136576:0@lo:103: 00010000:00010000:0.0:1782727443.005622:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727443.005633:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100136192:0@lo:103: 00010000:00010000:0.0:1782727443.005637:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f550479e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f55047a5 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.005647:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01539400 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:0.0:1782727443.005651:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f550479e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f55047a5 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.005660:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f550479e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f55047a5 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727443.005668:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f550479e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f55047a5 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727443.005674:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727443.005706:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f550479e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55047a5 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.005713:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727443.005739:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f550479e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55047a5 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.005746:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f550479e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55047a5 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.005767:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727443.005769:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727443.005771:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727443.005777:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727443.005779:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727443.005824:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100136704:0@lo:103: 00000100:00100000:3.0:1782727443.005850:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782727443.006439:0:5946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae01538000/0x8db73d43f55047f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f55047f2 expref: 14 pid: 5946 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727443.006453:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5946:1869325100135808:0@lo:104: 00010000:00010000:3.0:1782727443.006464:0:5946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae01538400/0x8db73d43f55047cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f55047c8 expref: 13 pid: 5946 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727443.006472:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5946:1869325100135936:0@lo:104: 00000100:00100000:3.0:1782727443.006481:0:5946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5946:1869325100136064:0@lo:104: 00010000:00010000:3.0:1782727443.006509:0:5946:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504854 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727443.006682:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100136704 00010000:00010000:2.0:1782727443.006688:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6400/0x8db73d43f55047c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55047cf expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727443.006689:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100136704 00010000:00010000:2.0:1782727443.006699:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6400/0x8db73d43f55047c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55047cf expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.006716:0:5939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae01538600/0x8db73d43f55047a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f550479e expref: 13 pid: 5947 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.006718:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727443.006722:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727443.006725:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727443.006754:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782727443.006763:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:3446:x1869325100136704:12345-0@lo:103: 00010000:00010000:0.0:1782727443.006774:0:5939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727443.006780:0:5939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae01538600/0x8db73d43f55047a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f550479e expref: 13 pid: 5947 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.006790:0:5939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae01538600/0x8db73d43f55047a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f550479e expref: 13 pid: 5947 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.006802:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae01538600/0x8db73d43f55047a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f550479e expref: 13 pid: 5947 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.006814:0:5939:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504854 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.006823:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504854 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.006837:0:5939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504854 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.006855:0:5939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504854 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.006861:0:5939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504854 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.006867:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504854 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.006873:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae013a0200 already unused, calling callback (ffffffffc0b2bcf0) 00010000:00010000:0.0:1782727443.006878:0:5939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504854 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.006885:0:5939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504854 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.006905:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504854 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.006915:0:5939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727443.006924:0:5946:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504854 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.006942:0:5946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504854 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.006949:0:5946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504854 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782727443.006964:0:5946:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1782727443.006974:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:3446:x1869325100136704:12345-0@lo:103: Request processed in 212us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727443.007825:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782727443.007944:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100136704:0@lo:103: 00000100:00100000:0.0:1782727443.015344:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+11:8007:x1869325100135424:12345-0@lo:253: Request processed in 28236us (29175us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727443.015359:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782727443.015710:0:8007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100135424:0@lo:253: 10000000:01000000:1.0:1782727443.015727:0:8007:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1782727443.015730:0:8007:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782727443.015732:0:8007:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782727443.015733:0:8007:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727443.015734:0:8007:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1782727443.015736:0:8007:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727443.015737:0:8007:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727443.015739:0:8007:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782727443.015740:0:8007:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1782727443.015742:0:8007:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727443.015743:0:8007:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1782727443.015765:0:8007:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90ae3dae6000 from lustre-OST0001 10000000:01000000:1.0:1782727443.015796:0:8007:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1782727443.015799:0:8007:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1782727443.015806:0:8007:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90ae0f4f0000 local copy 10000000:01000000:1.0:1782727443.015810:0:8007:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782727443.015844:0:8007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae013a0a00/0x8db73d43f550485b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727443.015856:0:8007:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.135@tcp lock: ffff90ae013a0a00/0x8db73d43f550485b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727443.015865:0:8007:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae013a0a00/0x8db73d43f550485b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727443.015881:0:8007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100136832:0@lo:101: 00000100:00100000:1.0:1782727443.015920:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727443.015964:0:8007:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0548b240 going to sleep for 11 seconds 00000100:00100000:2.0:1782727443.016097:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100136832 00000100:00100000:2.0:1782727443.016116:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100136832 00000100:00100000:2.0:1782727443.016158:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782727443.016166:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+11:8007:x1869325100136832:12345-0@lo:101: 00010000:00010000:2.0:1782727443.016179:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727443.016193:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae0a3c6400/0x8db73d43f5504862 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f550485b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.016217:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae0a3c6400/0x8db73d43f5504862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f550485b expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.016228:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae0a3c6400/0x8db73d43f5504862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f550485b expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.016236:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae0a3c6400, rc 0) 00000100:00100000:2.0:1782727443.016277:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:8007:x1869325100136832:12345-0@lo:101: Request processed in 112us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727443.016283:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782727443.016420:0:8007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100136832:0@lo:101: 00010000:00010000:3.0:1782727443.016435:0:8007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae013a0a00/0x8db73d43f550485b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8db73d43f5504862 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.016443:0:8007:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae013a0a00/0x8db73d43f550485b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8db73d43f5504862 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727443.016532:0:8007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100136960:0@lo:501: 00000100:00100000:3.0:1782727443.016561:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727443.016581:0:8007:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0843a300 going to sleep for 11 seconds 00000100:00100000:0.0:1782727443.016733:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100136960 00000100:00100000:0.0:1782727443.016737:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100136960 00000100:00100000:0.0:1782727443.016772:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782727443.016779:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:8007:x1869325100136960:12345-0@lo:501: 00000100:00100000:0.0:1782727443.016995:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:8007:x1869325100136960:12345-0@lo:501: Request processed in 215us (431us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782727443.017003:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782727443.017566:0:8007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100136960:0@lo:501: 10000000:01000000:3.0:1782727443.017583:0:8007:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782727443.017603:0:8007:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782727443.017686:0:8007:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae013a0a00/0x8db73d43f550485b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8db73d43f5504862 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.017696:0:8007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae013a0a00/0x8db73d43f550485b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8db73d43f5504862 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.017704:0:8007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff90ae013a0a00/0x8db73d43f550485b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8db73d43f5504862 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.017925:0:8007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782727443.017958:0:8007:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90ae3dae6000 10000000:01000000:3.0:1782727443.017964:0:8007:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782727443.017969:0:8007:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782727443.017972:0:8007:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782727443.017976:0:8007:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1782727443.017978:0:8007:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782727443.018006:0:8007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae01538400/0x8db73d43f5504869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.018029:0:8007:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae01538400/0x8db73d43f5504869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.018038:0:8007:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae01538400/0x8db73d43f5504869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727443.018057:0:8007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100137088:0@lo:101: 00000100:00100000:3.0:1782727443.018111:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727443.018148:0:8007:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0843af00 going to sleep for 11 seconds 00010000:00010000:0.0:1782727443.018245:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727443.018251:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae013a0a00/0x8db73d43f550485b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8db73d43f5504862 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.018258:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae013a0a00 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:0.0:1782727443.018262:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae013a0a00/0x8db73d43f550485b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8db73d43f5504862 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.018270:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae013a0a00/0x8db73d43f550485b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x8db73d43f5504862 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727443.018277:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae013a0a00/0x8db73d43f550485b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x8db73d43f5504862 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727443.018283:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727443.018304:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae013a0a00/0x8db73d43f550485b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8db73d43f5504862 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.018309:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782727443.018367:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727443.018438:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0332f07-5c7b-4a87-aafc-b3671573fb48:3444:1869325100137216:0@lo:103: 00000100:00100000:1.0:1782727443.018469:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100137088 00000100:00100000:3.0:1782727443.018474:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727443.018478:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100137088 00000100:00100000:3.0:1782727443.018520:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100137216 00000100:00100000:3.0:1782727443.018526:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100137216 00000100:00100000:1.0:1782727443.018536:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782727443.018558:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:8007:x1869325100137088:12345-0@lo:101: 00000100:00100000:3.0:1782727443.018561:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782727443.018571:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:3444:x1869325100137216:12345-0@lo:103: 00010000:00010000:3.0:1782727443.018584:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727443.018597:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae0a3c6400/0x8db73d43f5504862 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8db73d43f550485b expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.018713:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782727443.018841:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727443.018856:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504870 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f5504869 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727443.018875:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f5504869 expref: 13 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727443.018886:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504869 expref: 13 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727443.018894:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae013a0200, rc 0) 00000100:00100000:3.0:1782727443.018924:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:3444:x1869325100137216:12345-0@lo:103: Request processed in 352us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727443.018934:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782727443.018938:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:8007:x1869325100137088:12345-0@lo:101: Request processed in 381us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727443.018947:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782727443.018985:0:8007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100137088:0@lo:101: 00010000:00010000:3.0:1782727443.019002:0:8007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae01538400/0x8db73d43f5504869 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504870 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727443.019041:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0332f07-5c7b-4a87-aafc-b3671573fb48:3444:1869325100137216:0@lo:103: 00010000:00010000:0.0:1782727443.023968:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae013a0a00/0x8db73d43f550485b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x8db73d43f5504862 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.023986:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae013a0a00/0x8db73d43f550485b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x8db73d43f5504862 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.024010:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727443.024013:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727443.024037:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727443.024146:0:8007:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae01538400/0x8db73d43f5504869 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f5504870 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727443.024284:0:8007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100137344:0@lo:501: 00000100:00100000:3.0:1782727443.024360:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727443.024435:0:8007:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0843af00 going to sleep for 11 seconds 00000100:00100000:0.0:1782727443.026226:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100137344 00000100:00100000:0.0:1782727443.026238:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100137344 00000100:00100000:0.0:1782727443.026325:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782727443.026336:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:8007:x1869325100137344:12345-0@lo:501: 00000100:00100000:0.0:1782727443.026553:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:8007:x1869325100137344:12345-0@lo:501: Request processed in 219us (2192us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727443.026562:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782727443.028223:0:8007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100137344:0@lo:501: 00000100:00100000:3.0:1782727443.028293:0:8007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100137472:0@lo:503: 00000100:00100000:3.0:1782727443.028409:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727443.028454:0:8007:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0843af00 going to sleep for 11 seconds 00000100:00100000:2.0:1782727443.028853:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100137472 00000100:00100000:2.0:1782727443.028862:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100137472 00000100:00100000:2.0:1782727443.028932:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782727443.028943:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:8007:x1869325100137472:12345-0@lo:503: 00000100:00100000:2.0:1782727443.029140:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:8007:x1869325100137472:12345-0@lo:503: Request processed in 198us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727443.029148:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782727443.029820:0:8007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100137472:0@lo:503: 00000040:00080000:3.0:1782727443.030143:0:8007:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782727443.030490:0:8007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100137600:0@lo:502: 00000100:00100000:3.0:1782727443.030685:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727443.030773:0:8007:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0843af00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727443.030815:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100137600 00000100:00100000:1.0:1782727443.030823:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100137600 00000100:00100000:1.0:1782727443.030872:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782727443.030881:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:8007:x1869325100137600:12345-0@lo:502: 00000100:00100000:1.0:1782727443.031029:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:8007:x1869325100137600:12345-0@lo:502: Request processed in 148us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727443.031036:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782727443.031125:0:8007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100137600:0@lo:502: 00000040:00080000:3.0:1782727443.031472:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782727443.031501:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1782727443.031518:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1782727443.031531:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1782727443.031545:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1782727443.031649:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1782727443.031679:0:8007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100137728:0@lo:502: 00000100:00100000:3.0:1782727443.031727:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727443.031760:0:8007:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0843af00 going to sleep for 11 seconds 00000100:00100000:2.0:1782727443.032350:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100137728 00000100:00100000:2.0:1782727443.032357:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100137728 00000100:00100000:2.0:1782727443.032430:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782727443.032438:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:8007:x1869325100137728:12345-0@lo:502: 00000100:00100000:3.0:1782727443.032609:0:8007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100137728:0@lo:502: 00000040:00080000:3.0:1782727443.032662:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1782727443.032671:0:8007:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000100:00100000:2.0:1782727443.032685:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:8007:x1869325100137728:12345-0@lo:502: Request processed in 121us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727443.032693:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000020:01000000:3.0:1782727443.035925:0:8018:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782727443.035947:0:8018:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1782727443.035957:0:8018:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727443.035962:0:8018:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1782727443.035972:0:8018:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782727443.036000:0:8018:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90ae11fb99d0) 00000020:00000080:3.0:1782727443.036044:0:8018:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1782727443.036058:0:8018:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782727443.036159:0:8018:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90ae3dae6000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1782727443.036175:0:8018:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782727443.036187:0:8018:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8db73d43f550487e 00010000:00010000:3.0:1782727443.049179:0:8018:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1782727443.051214:0:8018:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1782727443.055647:0:8018:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1782727443.056867:0:8018:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1782727443.072094:0:8018:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1782727443.072296:0:8018:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1782727443.078749:0:8018:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1782727443.082839:0:8018:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1782727443.082851:0:8018:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727443.082858:0:8018:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727443.082860:0:8018:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1782727443.082864:0:8018:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727443.082867:0:8018:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727443.082869:0:8018:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782727443.082871:0:8018:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782727443.082873:0:8018:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782727443.082904:0:8018:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727443.082906:0:8018:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727443.082908:0:8018:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782727443.082910:0:8018:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1782727443.083349:0:8007:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1782727443.083460:0:8007:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1782727443.083482:0:8007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae01538400/0x8db73d43f5504869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504870 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.083494:0:8007:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae01538400/0x8db73d43f5504869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504870 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727443.083507:0:8007:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff90ae3dae6000 from 1 10000000:01000000:2.0:1782727443.083510:0:8007:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782727443.083550:0:8007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f5504885 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.083560:0:8007:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f5504885 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.083572:0:8007:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f5504885 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727443.083693:0:8007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100137856:0@lo:101: 00000100:00100000:2.0:1782727443.083764:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727443.083873:0:8007:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e5380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727443.083930:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100137856 00000100:00100000:3.0:1782727443.083938:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100137856 00000100:00100000:3.0:1782727443.084019:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782727443.084029:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:8007:x1869325100137856:12345-0@lo:101: 00010000:00010000:3.0:1782727443.084042:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727443.084061:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae01538000/0x8db73d43f550488c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f5504885 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.084096:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae01538000/0x8db73d43f550488c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f5504885 expref: 13 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.084108:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae01538000/0x8db73d43f550488c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504885 expref: 13 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.084118:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae01538000, rc 0) 00000100:00100000:3.0:1782727443.084165:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:8007:x1869325100137856:12345-0@lo:101: Request processed in 137us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727443.084172:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782727443.084407:0:8007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100137856:0@lo:101: 00010000:00010000:2.0:1782727443.084422:0:8007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f5504885 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550488c expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.084432:0:8007:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f5504885 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f550488c expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727443.084532:0:8007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100137984:0@lo:501: 00000100:00100000:2.0:1782727443.084560:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727443.084592:0:8007:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e5380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727443.085155:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100137984 00000100:00100000:3.0:1782727443.085162:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100137984 00000100:00100000:3.0:1782727443.085203:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1782727443.085212:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:8007:x1869325100137984:12345-0@lo:501: 00000100:00100000:3.0:1782727443.085512:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:8007:x1869325100137984:12345-0@lo:501: Request processed in 301us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727443.085520:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782727443.085800:0:8007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100137984:0@lo:501: 00000100:00100000:2.0:1782727443.085835:0:8007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100138112:0@lo:503: 00000100:00100000:2.0:1782727443.085883:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727443.085917:0:8007:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e5380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727443.086010:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100138112 00000100:00100000:3.0:1782727443.086014:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100138112 00000100:00100000:3.0:1782727443.086083:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782727443.086090:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:8007:x1869325100138112:12345-0@lo:503: 00000100:00100000:3.0:1782727443.086167:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:8007:x1869325100138112:12345-0@lo:503: Request processed in 76us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727443.086172:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782727443.086223:0:8007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100138112:0@lo:503: 00000040:00080000:2.0:1782727443.086480:0:8007:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782727443.086550:0:8007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100138240:0@lo:502: 00000100:00100000:2.0:1782727443.086592:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727443.086610:0:8007:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e5380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727443.086668:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100138240 00000100:00100000:3.0:1782727443.086672:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100138240 00000100:00100000:3.0:1782727443.086704:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782727443.086710:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:8007:x1869325100138240:12345-0@lo:502: 00000100:00100000:3.0:1782727443.086783:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:8007:x1869325100138240:12345-0@lo:502: Request processed in 72us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727443.086789:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782727443.086932:0:8007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100138240:0@lo:502: 00000040:00080000:2.0:1782727443.087103:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1782727443.087125:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1782727443.087143:0:8007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100138368:0@lo:502: 00000100:00100000:2.0:1782727443.087172:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727443.087233:0:8007:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e5380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727443.087274:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100138368 00000100:00100000:3.0:1782727443.087278:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100138368 00000100:00100000:3.0:1782727443.087302:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782727443.087308:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:8007:x1869325100138368:12345-0@lo:502: 00000100:00100000:3.0:1782727443.087392:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:8007:x1869325100138368:12345-0@lo:502: Request processed in 62us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727443.087399:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782727443.087482:0:8007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100138368:0@lo:502: 00000040:00080000:2.0:1782727443.087522:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1782727443.087531:0:8007:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1782727443.095207:0:8021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727443.095223:0:8021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727443.095225:0:8021:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782727443.095234:0:8021:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff90ae3dae6000 00000020:00000080:1.0:1782727443.095237:0:8021:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782727443.095248:0:8021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727443.095251:0:8021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727443.095261:0:8021:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1782727443.095265:0:8021:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1782727443.095757:0:8007:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1782727443.095792:0:8007:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782727443.096337:0:8007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f5504885 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550488c expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.096352:0:8007:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f5504885 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550488c expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727443.096447:0:8007:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782727443.096451:0:8007:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90ae3dae6000 10000000:01000000:2.0:1782727443.096455:0:8007:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90ae3dae6000 10000000:01000000:2.0:1782727443.096462:0:8007:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782727443.096469:0:8007:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff90ae3dae6000 from 1 10000000:01000000:2.0:1782727443.096472:0:8007:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782727443.096509:0:8007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504893 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.096518:0:8007:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504893 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.096530:0:8007:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504893 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727443.096553:0:8007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100138496:0@lo:101: 00000100:00100000:2.0:1782727443.096624:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727443.096672:0:8007:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e5383c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727443.101899:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100138496 00000100:00100000:1.0:1782727443.101916:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100138496 00000100:00100000:1.0:1782727443.102001:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782727443.102011:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:8007:x1869325100138496:12345-0@lo:101: 00010000:00010000:1.0:1782727443.102027:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727443.102043:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae013a0800/0x8db73d43f550489a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f5504893 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727443.102071:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae013a0800/0x8db73d43f550489a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f5504893 expref: 14 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727443.102095:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae013a0800/0x8db73d43f550489a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504893 expref: 14 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727443.102104:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae013a0800, rc 0) 00000100:00100000:1.0:1782727443.102198:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:8007:x1869325100138496:12345-0@lo:101: Request processed in 187us (5573us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727443.102205:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782727443.102285:0:8007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100138496:0@lo:101: 00010000:00010000:3.0:1782727443.102304:0:8007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504893 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550489a expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.102315:0:8007:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504893 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f550489a expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727443.102454:0:8007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100138624:0@lo:501: 00000100:00100000:3.0:1782727443.102502:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727443.102539:0:8007:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b317cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727443.102904:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100138624 00000100:00100000:1.0:1782727443.102909:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100138624 00000100:00100000:1.0:1782727443.102944:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1782727443.102952:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:8007:x1869325100138624:12345-0@lo:501: 00000100:00100000:1.0:1782727443.103064:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:8007:x1869325100138624:12345-0@lo:501: Request processed in 113us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727443.103071:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782727443.108629:0:8007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100138624:0@lo:501: 00000100:00100000:2.0:1782727443.108716:0:8007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100138752:0@lo:503: 00000100:00100000:2.0:1782727443.108800:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727443.108849:0:8007:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e5386c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727443.108906:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100138752 00000100:00100000:1.0:1782727443.108913:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100138752 00000100:00100000:1.0:1782727443.108981:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782727443.108989:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:8007:x1869325100138752:12345-0@lo:503: 00000100:00100000:1.0:1782727443.109124:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:8007:x1869325100138752:12345-0@lo:503: Request processed in 135us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727443.109133:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782727443.109214:0:8007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100138752:0@lo:503: 00000040:00080000:2.0:1782727443.109527:0:8007:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782727443.109617:0:8007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100138880:0@lo:502: 00000100:00100000:2.0:1782727443.109655:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727443.109680:0:8007:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e5386c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727443.110431:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100138880 00000100:00100000:0.0:1782727443.110439:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100138880 00000100:00100000:0.0:1782727443.110490:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1782727443.110500:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:8007:x1869325100138880:12345-0@lo:502: 00000100:00100000:0.0:1782727443.110640:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:8007:x1869325100138880:12345-0@lo:502: Request processed in 140us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727443.110647:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782727443.110734:0:8007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100138880:0@lo:502: 00000040:00080000:2.0:1782727443.110981:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1782727443.111010:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1782727443.111026:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1782727443.111039:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1782727443.111052:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1782727443.111065:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1782727443.111093:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1782727443.111108:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1782727443.111121:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1782727443.111134:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1782727443.111146:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1782727443.111157:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1782727443.111169:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1782727443.111181:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1782727443.111199:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1782727443.111211:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1782727443.111236:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1782727443.111248:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1782727443.111262:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1782727443.111276:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1782727443.111312:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1782727443.111326:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1782727443.111339:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1782727443.111350:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1782727443.111362:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1782727443.111408:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1782727443.111485:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1782727443.111506:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1782727443.111518:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1782727443.111529:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1782727443.111539:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1782727443.111550:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1782727443.111574:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1782727443.111589:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1782727443.111603:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1782727443.111616:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1782727443.111629:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1782727443.111662:0:8007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100139008:0@lo:502: 00000100:00100000:3.0:1782727443.111717:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727443.111843:0:8007:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b317cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727443.112112:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100139008 00000100:00100000:1.0:1782727443.112119:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100139008 00000100:00100000:1.0:1782727443.112168:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782727443.112176:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:8007:x1869325100139008:12345-0@lo:502: 00000100:00100000:1.0:1782727443.112305:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:8007:x1869325100139008:12345-0@lo:502: Request processed in 128us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727443.112314:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782727443.112334:0:8007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100139008:0@lo:502: 00000040:00080000:3.0:1782727443.112571:0:8007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1782727443.112582:0:8007:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1782727443.113445:0:8023:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1782727443.113471:0:8023:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90ae3de119d0) 00000020:00000080:0.0:1782727443.113498:0:8023:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1782727443.113848:0:8023:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90ae3dae6000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1782727443.113852:0:8023:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90ae3dae6000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1782727443.113854:0:8023:0:(obd_mount.c:701:lustre_put_lsi()) put ffff90ae3dae6000 3 00010000:00080000:0.0:1782727443.113881:0:8023:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90ae3d874800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1782727443.131722:0:8023:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1782727443.131840:0:8023:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1782727443.131906:0:8023:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782727443.131920:0:8023:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8db73d43f55048a8 00000100:00080000:2.0:1782727443.131932:0:8023:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782727443.131939:0:8023:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90ae3d874800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1782727443.131975:0:8023:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90ae3b0ef100 x1869325100139136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782727443.132002:0:8023:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782727443.132368:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3442:1869325100139136:0@lo:38: 00000100:00100000:0.0:1782727443.132482:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727443.132684:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325100139264:0@lo:400: 00000100:00100000:1.0:1782727443.132719:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727443.132756:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325100139392:0@lo:400: 00000100:00100000:1.0:1782727443.132784:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727443.132804:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727443.132812:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100139520:0@lo:400: 00000100:00100000:1.0:1782727443.132836:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727443.132866:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100139136 00000100:00100000:1.0:1782727443.132873:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100139136 00000100:00100000:1.0:1782727443.132898:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100139264 00000100:00100000:1.0:1782727443.132900:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100139264 00000100:00100000:1.0:1782727443.132922:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100139392 00000100:00100000:1.0:1782727443.132924:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100139392 00000100:00100000:1.0:1782727443.132949:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782727443.132959:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325100139264:12345-0@lo:400: 00000100:00100000:1.0:1782727443.133017:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325100139264:12345-0@lo:400: Request processed in 59us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727443.133034:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782727443.133057:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782727443.133065:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325100139392:12345-0@lo:400: 00000100:00100000:1.0:1782727443.133120:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325100139392:12345-0@lo:400: Request processed in 56us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727443.133127:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782727443.133146:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782727443.133152:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3442:x1869325100139136:12345-0@lo:38: 00010000:00080000:1.0:1782727443.133172:0:5952:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:1.0:1782727443.133208:0:5952:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8db73d43f55048af 00000004:00100000:1.0:1782727443.133226:0:5952:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782727443.133257:0:5952:0:(import.c:65:import_set_state_nolock()) ffff90ae3ddf8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782727443.133416:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100139520 00000100:00100000:0.0:1782727443.133421:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100139520 00000100:00100000:0.0:1782727443.133457:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782727443.133465:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100139520:12345-0@lo:400: 00010000:00080000:3.0:1782727443.135395:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae3b0ef100 x1869325100139136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782727453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727443.135409:0:3442:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782727443.135419:0:3442:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1782727443.135427:0:3442:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000040:00080000:2.0:1782727443.135432:0:8023:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:3.0:1782727443.135433:0:3442:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782727443.135438:0:3442:0:(import.c:65:import_set_state_nolock()) ffff90ae3d874800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782727443.135447:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3442:1869325100139136:0@lo:38: 00000020:01000000:3.0:1782727443.135523:0:8007:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1782727443.135558:0:8007:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782727443.136020:0:8007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504893 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550489a expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.136033:0:8007:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550489a expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782727443.136113:0:8007:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782727443.136119:0:8007:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782727443.136120:0:8007:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727443.136121:0:8007:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727443.136122:0:8007:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727443.136124:0:8007:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727443.136125:0:8007:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727443.136127:0:8007:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727443.136128:0:8007:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727443.136129:0:8007:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727443.136131:0:8007:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782727443.136134:0:8007:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1782727443.136136:0:8007:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782727443.136138:0:8007:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782727443.136139:0:8007:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727443.136140:0:8007:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727443.136141:0:8007:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727443.136142:0:8007:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727443.136143:0:8007:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727443.136144:0:8007:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727443.136145:0:8007:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727443.136145:0:8007:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727443.136146:0:8007:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782727443.136168:0:8007:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1782727443.136183:0:8007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100139648:0@lo:253: 00000100:00100000:2.0:1782727443.137505:0:8025:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ef480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:8025:1869325100139776:0@lo:901: 00000100:00100000:0.0:1782727443.137914:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100139520:12345-0@lo:400: Request processed in 4446us (5073us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727443.137928:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1782727443.138950:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782727443.139029:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782727443.140156:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae37f50000 x1869325100139264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727443.140172:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325100139264:0@lo:400: 00000100:00100000:1.0:1782727443.140703:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1869325100139136:12345-0@lo:38: Request processed in 7546us (8218us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727443.140715:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782727443.140744:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1782727443.140767:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae37f50e00 x1869325100139520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727443.140778:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100139520:0@lo:400: 00010000:00080000:1.0:1782727443.140794:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae37f50700 x1869325100139392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727443.140802:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325100139392:0@lo:400: 00000100:00100000:3.0:1782727443.140832:0:8007:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae031fba80 going to sleep for 11 seconds 00000100:00100000:0.0:1782727443.140874:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100139648 00000100:00100000:0.0:1782727443.140882:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100139648 00000100:00100000:0.0:1782727443.140929:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782727443.140937:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:8007:x1869325100139648:12345-0@lo:253: 20000000:01000000:0.0:1782727443.140970:0:5944:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1782727443.140985:0:5944:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1782727443.141844:0:8025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727443.141869:0:8025:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e5386c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727443.142202:0:5963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100139776 00000100:00100000:0.0:1782727443.142209:0:5963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100139776 00000100:00080000:2.0:1782727443.142256:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727443.142268:0:5963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782727443.142305:0:5963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8025:x1869325100139776:12345-0@lo:901: 00000100:00100000:2.0:1782727443.142465:0:5963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8025:x1869325100139776:12345-0@lo:901: Request processed in 160us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727443.142476:0:5963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782727443.143164:0:8025:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90ae3b0ef480 x1869325100139776/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1782727459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727443.143359:0:8025:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ef480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:8025:1869325100139776:0@lo:901: 20000000:01000000:0.0:1782727443.150428:0:5944:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782727443.150449:0:5944:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1782727443.150488:0:5968:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1782727443.150494:0:5968:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1782727443.150517:0:5968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90ae01538a00/0x8db73d43f55048b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.150554:0:5968:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae0a3c7600/0x8db73d43f5504807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504800 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.150564:0:5968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90ae01538a00/0x8db73d43f55048b6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727443.150603:0:5968:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae0a3c7600/0x8db73d43f5504807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f5504800 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727443.150901:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:8007:x1869325100139648:12345-0@lo:253: Request processed in 9962us (10156us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727443.150913:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:3.0:1782727443.150961:0:5968:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae0a3c7600/0x8db73d43f5504807 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f5504800 expref: 13 pid: 5944 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727443.150975:0:5968:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5968:1869325100139904:0@lo:104: 00000100:00100000:3.0:1782727443.151014:0:5968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727443.151036:0:8007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0332f07-5c7b-4a87-aafc-b3671573fb48:8007:1869325100139648:0@lo:253: 10000000:01000000:1.0:1782727443.151054:0:8007:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000100:00100000:3.0:1782727443.151057:0:5968:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae02bcda80 going to sleep for 11 seconds 00000020:01000004:1.0:1782727443.151058:0:8007:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782727443.151067:0:8007:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782727443.151070:0:8007:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727443.151071:0:8007:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727443.151084:0:8007:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727443.151086:0:8007:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727443.151087:0:8007:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782727443.151089:0:8007:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727443.151090:0:8007:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727443.151092:0:8007:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727443.151093:0:8007:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782727443.151110:0:8007:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1782727443.154678:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100139904 00000100:00100000:0.0:1782727443.154693:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100139904 00000100:00100000:0.0:1782727443.154762:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782727443.154772:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:5968:x1869325100139904:12345-0@lo:104: 00010000:00010000:0.0:1782727443.154791:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae00030800/0x8db73d43f5504800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f5504807 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.154914:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782727443.154920:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:5968:x1869325100139904:12345-0@lo:104: Request processed in 150us (3906us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727443.154926:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1782727443.154951:0:8017:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727443.154960:0:8017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae00030800/0x8db73d43f5504800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f5504807 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.154969:0:8017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae00030800 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:2.0:1782727443.154974:0:8017:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae00030800/0x8db73d43f5504800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f5504807 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727443.154978:0:5968:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5968:1869325100139904:0@lo:104: 00010000:00010000:0.0:1782727443.155004:0:5968:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90ae01538a00/0x8db73d43f55048b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.155028:0:8017:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae00030800/0x8db73d43f5504800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f5504807 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727443.155036:0:8017:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae00030800/0x8db73d43f5504800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f5504807 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727443.155041:0:8017:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782727443.155104:0:8017:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae00030800/0x8db73d43f5504800 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504807 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.155111:0:8017:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782727443.155128:0:8017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae00030800/0x8db73d43f5504800 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504807 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.155135:0:8017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae00030800/0x8db73d43f5504800 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504807 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.155151:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727443.155153:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727443.155154:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727443.155430:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100140032:0@lo:103: 00000100:00100000:0.0:1782727443.155475:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727443.155523:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100140032 00000100:00100000:2.0:1782727443.155528:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100140032 00010000:00010000:2.0:1782727443.155550:0:5939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae0a3c7600/0x8db73d43f5504807 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f5504800 expref: 14 pid: 5944 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727443.155580:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782727443.155587:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3416c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:3443:x1869325100140032:12345-0@lo:103: 00010000:00010000:2.0:1782727443.155598:0:5939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727443.155603:0:5939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae0a3c7600/0x8db73d43f5504807 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f5504800 expref: 14 pid: 5944 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.155700:0:5939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae0a3c7600/0x8db73d43f5504807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f5504800 expref: 14 pid: 5944 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.155715:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae0a3c7600/0x8db73d43f5504807 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f5504800 expref: 14 pid: 5944 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.155729:0:5939:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90ae01538a00/0x8db73d43f55048b6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.155744:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae01538a00/0x8db73d43f55048b6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782727443.155759:0:5939:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005265664s 00010000:00010000:2.0:1782727443.155763:0:5939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ae01538a00/0x8db73d43f55048b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.155770:0:5939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ae01538a00/0x8db73d43f55048b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.155777:0:5939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90ae01538a00/0x8db73d43f55048b6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.155783:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90ae01538a00/0x8db73d43f55048b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.155789:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01538a00 already unused, calling callback (ffffffffc0b2bcf0) 00010000:00010000:2.0:1782727443.155792:0:5939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90ae01538a00/0x8db73d43f55048b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.155799:0:5939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90ae01538a00/0x8db73d43f55048b6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.155817:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90ae01538a00/0x8db73d43f55048b6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727443.155826:0:5939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727443.155856:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3416c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:3443:x1869325100140032:12345-0@lo:103: Request processed in 270us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727443.155862:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782727443.156147:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100140032:0@lo:103: 00010000:00010000:0.0:1782727443.156168:0:5968:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90ae01538a00/0x8db73d43f55048b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.156177:0:5968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90ae01538a00/0x8db73d43f55048b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727443.156192:0:5968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae01538a00/0x8db73d43f55048b6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1782727443.164429:0:8007:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1782727443.164722:0:8007:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1782727443.164905:0:8007:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1782727443.165065:0:8007:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1782727443.165308:0:8007:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1782727443.165553:0:8007:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1782727443.176221:0:8007:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1782727443.189269:0:8007:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1782727443.189280:0:8007:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1782727443.189321:0:8007:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782727443.189411:0:8007:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782727443.189678:0:8007:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1782727443.189701:0:8007:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1782727443.191016:0:8007:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727443.191318:0:8007:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1782727443.493564:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782727443.971538:0:8077:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727443.971756:0:8077:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782727444.517638:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727445.542617:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727445.672797:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782727445.672833:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100140160:0@lo:13: 00000100:00100000:1.0:1782727445.672936:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727445.673204:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100140160 00000100:00100000:2.0:1782727445.673215:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100140160 00000100:00100000:2.0:1782727445.673308:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782727445.673320:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100140160:12345-0@lo:13: 00002000:00000024:2.0:1782727445.673369:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00080000:0.0:1782727445.673522:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727445.673662:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100140160:12345-0@lo:13: Request processed in 343us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727445.673670:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1782727445.673757:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b0ec380 x1869325100140160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727445.673784:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100140160:0@lo:13: 00010000:00010000:2.0:1782727446.565597:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727447.592462:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727448.229913:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869325100140416:0@lo:400: 00000100:00100000:3.0:1782727448.229918:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325100140544:0@lo:400: 00000100:00100000:0.0:1782727448.230005:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727448.230034:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100140288:0@lo:400: 00000100:00100000:1.0:1782727448.230069:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727448.230070:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100140672:0@lo:400: 00000100:00100000:1.0:1782727448.230092:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325100140800:0@lo:400: 00000100:00100000:0.0:1782727448.230094:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727448.230116:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727448.230136:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100140416 00000100:00100000:0.0:1782727448.230143:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100140416 00000100:00100000:0.0:1782727448.230183:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100140800 00000100:00100000:0.0:1782727448.230186:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100140800 00000100:00100000:0.0:1782727448.230210:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782727448.230218:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869325100140416:12345-0@lo:400: 00000100:00100000:3.0:1782727448.230246:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727448.230267:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869325100140416:12345-0@lo:400: Request processed in 49us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727448.230274:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782727448.230295:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100140544 00000100:00100000:0.0:1782727448.230298:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100140544 00000100:00100000:0.0:1782727448.230312:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782727448.230313:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100140288 00000100:00100000:1.0:1782727448.230316:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100140288 00000100:00100000:0.0:1782727448.230317:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325100140800:12345-0@lo:400: 00000100:00100000:0.0:1782727448.230447:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325100140800:12345-0@lo:400: Request processed in 128us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727448.230454:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782727448.230468:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782727448.230476:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325100140544:12345-0@lo:400: 00000100:00100000:0.0:1782727448.230586:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325100140544:12345-0@lo:400: Request processed in 113us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727448.230591:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782727448.230611:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100140672 00000100:00100000:0.0:1782727448.230614:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100140672 00000100:00100000:0.0:1782727448.230639:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782727448.230645:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100140672:12345-0@lo:400: 00000100:00100000:0.0:1782727448.230677:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100140672:12345-0@lo:400: Request processed in 32us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727448.230683:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1782727448.230698:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782727448.230702:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782727448.230731:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae035be680 x1869325100140672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727448.230745:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100140672:0@lo:400: 00000100:00100000:3.0:1782727448.230755:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782727448.230764:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:3445:x1869325100140288:12345-0@lo:400: 00010000:00080000:0.0:1782727448.230772:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae035be300 x1869325100140416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727448.230781:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869325100140416:0@lo:400: 00000100:00100000:3.0:1782727448.230794:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:3445:x1869325100140288:12345-0@lo:400: Request processed in 33us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727448.230801:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:3.0:1782727448.230837:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae035bfb80 x1869325100140544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727448.230845:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325100140544:0@lo:400: 00000100:00100000:1.0:1782727448.230919:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100140288:0@lo:400: 00010000:00080000:1.0:1782727448.231038:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae035bed80 x1869325100140800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727448.231048:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325100140800:0@lo:400: 00010000:00010000:3.0:1782727448.614663:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782727448.959553:0:8367:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1782727449.638565:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782727449.979993:0:8419:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782727449.980283:0:8419:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782727450.665015:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727450.789739:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727450.789777:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100140928:0@lo:13: 00000100:00100000:1.0:1782727450.789875:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727450.790074:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100140928 00000100:00100000:2.0:1782727450.790085:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100140928 00000100:00100000:2.0:1782727450.790244:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782727450.790256:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100140928:12345-0@lo:13: 00002000:00000024:2.0:1782727450.790298:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727450.790370:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100140928:12345-0@lo:13: Request processed in 116us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727450.790419:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1782727450.790503:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b0eea00 x1869325100140928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727450.790535:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100140928:0@lo:13: 00000100:00080000:3.0:1782727450.790639:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782727451.686962:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782727452.331444:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782727452.331455:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff90ae06bcd800 from 30 10000000:01000000:0.0:1782727452.331463:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782727452.331527:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae00031800/0x8db73d43f55048bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727452.331542:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae00031800/0x8db73d43f55048bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727452.331574:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae00031800/0x8db73d43f55048bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727452.331612:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100141056:0@lo:101: 00000100:00100000:0.0:1782727452.331713:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.334192:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3ddd8900 going to sleep for 11 seconds 00000100:00100000:0.0:1782727452.334245:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100141056 00000100:00100000:0.0:1782727452.334257:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100141056 00000100:00100000:0.0:1782727452.334343:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1782727452.334355:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:5949:x1869325100141056:12345-0@lo:101: 00010000:00010000:0.0:1782727452.334404:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727452.334433:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae00030a00/0x8db73d43f55048c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f55048bd expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727452.334471:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae00030a00/0x8db73d43f55048c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f55048bd expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727452.334486:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae00030a00/0x8db73d43f55048c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55048bd expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727452.334497:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae00030a00, rc 0) 00000100:00100000:0.0:1782727452.334572:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:5949:x1869325100141056:12345-0@lo:101: Request processed in 219us (2859us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727452.334581:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1782727452.334655:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100141056:0@lo:101: 00010000:00010000:0.0:1782727452.334679:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae00031800/0x8db73d43f55048bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55048c4 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727452.334709:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae00031800/0x8db73d43f55048bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f55048c4 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727452.335496:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100141184:0@lo:501: 00000100:00100000:0.0:1782727452.335554:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.335595:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3ddd8900 going to sleep for 11 seconds 00000100:00100000:2.0:1782727452.336135:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100141184 00000100:00100000:2.0:1782727452.336145:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100141184 00000100:00100000:2.0:1782727452.336198:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782727452.336211:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:5949:x1869325100141184:12345-0@lo:501: 00000100:00100000:2.0:1782727452.336452:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:5949:x1869325100141184:12345-0@lo:501: Request processed in 242us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727452.336460:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1782727452.336710:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100141184:0@lo:501: 00000100:00100000:0.0:1782727452.336833:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100141312:0@lo:503: 00000100:00100000:0.0:1782727452.336889:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.336937:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3ddd8900 going to sleep for 11 seconds 00000100:00100000:1.0:1782727452.339105:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100141312 00000100:00100000:1.0:1782727452.339124:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100141312 00000100:00100000:1.0:1782727452.339200:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782727452.339211:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:5949:x1869325100141312:12345-0@lo:503: 00000100:00100000:1.0:1782727452.339809:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:5949:x1869325100141312:12345-0@lo:503: Request processed in 597us (2917us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727452.339820:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1782727452.339947:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100141312:0@lo:503: 00000100:00100000:2.0:1782727452.344207:0:8483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0eea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8483:1869325100141440:0@lo:502: 00000100:00100000:2.0:1782727452.344326:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727452.344407:0:8483:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b3cec00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727452.344433:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100141440 00000100:00100000:1.0:1782727452.344443:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100141440 00000100:00100000:1.0:1782727452.344515:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782727452.344527:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:8483:x1869325100141440:12345-0@lo:502: 00000100:00100000:1.0:1782727452.344712:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:8483:x1869325100141440:12345-0@lo:502: Request processed in 187us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727452.344728:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782727452.344824:0:8483:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0eea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8483:1869325100141440:0@lo:502: 00000100:00100000:2.0:1782727452.344904:0:8483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0eea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8483:1869325100141568:0@lo:502: 00000100:00100000:2.0:1782727452.344941:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727452.344972:0:8483:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b3cec00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727452.345077:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100141568 00000100:00100000:1.0:1782727452.345082:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100141568 00000100:00100000:1.0:1782727452.345115:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782727452.345123:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:8483:x1869325100141568:12345-0@lo:502: 00000100:00100000:1.0:1782727452.345207:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:8483:x1869325100141568:12345-0@lo:502: Request processed in 83us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727452.345215:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782727452.345246:0:8483:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0eea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8483:1869325100141568:0@lo:502: 00000040:00080000:2.0:1782727452.345280:0:8483:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1782727452.345635:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1782727452.345669:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782727452.345683:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae00031800/0x8db73d43f55048bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55048c4 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727452.345695:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae00031800/0x8db73d43f55048bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55048c4 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727452.345707:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1782727452.345710:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1782727452.345714:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1782727452.345757:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae013a1c00/0x8db73d43f55048cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727452.345766:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae013a1c00/0x8db73d43f55048cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727452.345776:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae013a1c00/0x8db73d43f55048cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727452.345791:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f51180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100141696:0@lo:101: 00000100:00100000:1.0:1782727452.345837:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727452.345862:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0f55c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727452.346071:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100141696 00000100:00100000:0.0:1782727452.346147:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100141696 00000100:00100000:0.0:1782727452.346760:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782727452.346842:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:5949:x1869325100141696:12345-0@lo:101: 00010000:00010000:0.0:1782727452.346964:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727452.346994:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae00030c00/0x8db73d43f55048d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f55048cb expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727452.347045:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae00030c00/0x8db73d43f55048d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f55048cb expref: 15 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727452.347063:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae00030c00/0x8db73d43f55048d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55048cb expref: 15 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727452.347079:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae00030c00, rc 0) 00000100:00100000:0.0:1782727452.347189:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:5949:x1869325100141696:12345-0@lo:101: Request processed in 350us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727452.347197:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782727452.347330:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f51180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100141696:0@lo:101: 00010000:00010000:1.0:1782727452.347350:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae013a1c00/0x8db73d43f55048cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55048d2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727452.347361:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae013a1c00/0x8db73d43f55048cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f55048d2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727452.347470:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f51180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100141824:0@lo:501: 00000100:00100000:1.0:1782727452.347505:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.350095:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100141824 00000100:00100000:0.0:1782727452.350115:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100141824 00000100:00100000:0.0:1782727452.350178:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782727452.350189:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:5949:x1869325100141824:12345-0@lo:501: 00000100:00100000:0.0:1782727452.350760:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:5949:x1869325100141824:12345-0@lo:501: Request processed in 570us (3252us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727452.350838:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782727452.351123:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0f55c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727452.351156:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f51180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100141824:0@lo:501: 00000100:00100000:1.0:1782727452.351217:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f51180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100141952:0@lo:503: 00000100:00100000:1.0:1782727452.351277:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727452.351454:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0f55c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727452.351520:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100141952 00000100:00100000:0.0:1782727452.351527:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100141952 00000100:00100000:0.0:1782727452.351643:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782727452.351652:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:5949:x1869325100141952:12345-0@lo:503: 00000100:00100000:0.0:1782727452.352007:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:5949:x1869325100141952:12345-0@lo:503: Request processed in 355us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727452.352015:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1782727452.352100:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f51180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100141952:0@lo:503: 00000100:00100000:0.0:1782727452.352624:0:8484:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8484:1869325100142080:0@lo:502: 00000100:00100000:0.0:1782727452.352684:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.352713:0:8484:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3ddd89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727452.352848:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100142080 00000100:00100000:1.0:1782727452.352930:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100142080 00000100:00100000:1.0:1782727452.352975:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782727452.352983:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:8484:x1869325100142080:12345-0@lo:502: 00000100:00100000:1.0:1782727452.353106:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:8484:x1869325100142080:12345-0@lo:502: Request processed in 122us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727452.353114:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782727452.353209:0:8484:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8484:1869325100142080:0@lo:502: 00000020:01000000:0.0:1782727452.353240:0:8484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727452.353252:0:8484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727452.353254:0:8484:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782727452.353259:0:8484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782727452.353261:0:8484:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1782727452.353278:0:8484:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8484:1869325100142208:0@lo:502: 00000100:00100000:0.0:1782727452.353323:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.353356:0:8484:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3ddd89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727452.353445:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100142208 00000100:00100000:1.0:1782727452.353450:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100142208 00000100:00100000:1.0:1782727452.353513:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782727452.353520:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:8484:x1869325100142208:12345-0@lo:502: 00000100:00100000:1.0:1782727452.353595:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:8484:x1869325100142208:12345-0@lo:502: Request processed in 75us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727452.353602:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1782727452.353729:0:8484:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8484:1869325100142208:0@lo:502: 00000020:01000000:0.0:1782727452.353750:0:8484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727452.353754:0:8484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727452.353756:0:8484:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782727452.353760:0:8484:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1782727452.354092:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1782727452.354121:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782727452.354134:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae013a1c00/0x8db73d43f55048cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55048d2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727452.354147:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae013a1c00/0x8db73d43f55048cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55048d2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727452.354160:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782727452.354163:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff90ae052c9800 from 30 10000000:01000000:1.0:1782727452.354166:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782727452.354197:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae013a0600/0x8db73d43f55048d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727452.354207:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae013a0600/0x8db73d43f55048d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727452.354217:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae013a0600/0x8db73d43f55048d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727452.354232:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f51180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100142336:0@lo:101: 00000100:00100000:1.0:1782727452.354267:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.354749:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100142336 00000100:00100000:0.0:1782727452.354758:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100142336 00000100:00100000:2.0:1782727452.354812:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0f55c900 going to sleep for 11 seconds 00000100:00100000:2.0:1782727452.354927:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782727452.354939:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:5949:x1869325100142336:12345-0@lo:101: 00010000:00010000:2.0:1782727452.354955:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727452.355053:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae0a3c7c00/0x8db73d43f55048e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f55048d9 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727452.355169:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae0a3c7c00/0x8db73d43f55048e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f55048d9 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727452.355179:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae0a3c7c00/0x8db73d43f55048e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55048d9 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727452.355190:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae0a3c7c00, rc 0) 00000100:00100000:2.0:1782727452.355416:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:5949:x1869325100142336:12345-0@lo:101: Request processed in 480us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727452.355424:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782727452.355870:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f51180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100142336:0@lo:101: 00010000:00010000:1.0:1782727452.355891:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae013a0600/0x8db73d43f55048d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55048e0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727452.355921:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae013a0600/0x8db73d43f55048d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f55048e0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727452.356148:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f51180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100142464:0@lo:501: 00000100:00100000:1.0:1782727452.356190:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727452.356664:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0f55c900 going to sleep for 11 seconds 00000100:00100000:0.0:1782727452.356792:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100142464 00000100:00100000:0.0:1782727452.356800:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100142464 00000100:00100000:0.0:1782727452.356890:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782727452.356910:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:5949:x1869325100142464:12345-0@lo:501: 00000100:00100000:0.0:1782727452.357411:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:5949:x1869325100142464:12345-0@lo:501: Request processed in 501us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727452.357420:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782727452.357658:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f51180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100142464:0@lo:501: 00000100:00100000:2.0:1782727452.357715:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100142592:0@lo:503: 00000100:00100000:2.0:1782727452.357849:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727452.357929:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b3ceb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782727452.358064:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100142592 00000100:00100000:0.0:1782727452.358071:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100142592 00000100:00100000:0.0:1782727452.358119:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782727452.358127:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:5949:x1869325100142592:12345-0@lo:503: 00000100:00100000:0.0:1782727452.358255:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:5949:x1869325100142592:12345-0@lo:503: Request processed in 128us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727452.358275:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782727452.358330:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100142592:0@lo:503: 00000100:00100000:0.0:1782727452.358590:0:8485:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8485:1869325100142720:0@lo:502: 00000100:00100000:0.0:1782727452.358627:0:8485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.358646:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100142720 00000100:00100000:0.0:1782727452.358656:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100142720 00000100:00100000:0.0:1782727452.358677:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782727452.358684:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:8485:x1869325100142720:12345-0@lo:502: 00000100:00100000:0.0:1782727452.358919:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:8485:x1869325100142720:12345-0@lo:502: Request processed in 233us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727452.358926:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782727452.358962:0:8485:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae10c1e480 going to sleep for 11 seconds 00000100:00100000:0.0:1782727452.359131:0:8485:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8485:1869325100142720:0@lo:502: 00000100:00100000:0.0:1782727452.359178:0:8485:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8485:1869325100142848:0@lo:502: 00000100:00100000:0.0:1782727452.359212:0:8485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.359337:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100142848 00000100:00100000:0.0:1782727452.359343:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100142848 00000100:00100000:0.0:1782727452.359365:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782727452.359400:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:8485:x1869325100142848:12345-0@lo:502: 00000100:00100000:0.0:1782727452.359465:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:8485:x1869325100142848:12345-0@lo:502: Request processed in 94us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727452.359472:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782727452.359500:0:8485:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae18250d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782727452.359510:0:8485:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8485:1869325100142848:0@lo:502: 00000040:00080000:0.0:1782727452.359529:0:8485:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1782727452.359594:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1782727452.359619:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782727452.359631:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae013a0600/0x8db73d43f55048d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55048e0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727452.359643:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae013a0600/0x8db73d43f55048d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55048e0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727452.359664:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782727452.359667:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff90ae052c9800 from 5 10000000:01000000:0.0:1782727452.359670:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782727452.359704:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae00030200/0x8db73d43f55048e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727452.359712:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae00030200/0x8db73d43f55048e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727452.359722:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae00030200/0x8db73d43f55048e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727452.359908:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100142976:0@lo:101: 00000100:00100000:0.0:1782727452.359942:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.359960:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae18250d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782727452.360087:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100142976 00000100:00100000:1.0:1782727452.360093:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100142976 00000100:00100000:1.0:1782727452.360130:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1782727452.360137:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:5949:x1869325100142976:12345-0@lo:101: 00010000:00010000:1.0:1782727452.360147:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727452.360164:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae013a0a00/0x8db73d43f55048ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f55048e7 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727452.360188:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae013a0a00/0x8db73d43f55048ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f55048e7 expref: 17 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727452.360199:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae013a0a00/0x8db73d43f55048ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55048e7 expref: 17 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727452.360209:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae013a0a00, rc 0) 00000100:00100000:1.0:1782727452.360250:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100142976:12345-0@lo:101: Request processed in 114us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727452.360256:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782727452.360461:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100142976:0@lo:101: 00010000:00010000:0.0:1782727452.360474:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae00030200/0x8db73d43f55048e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55048ee expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727452.360483:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae00030200/0x8db73d43f55048e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f55048ee expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727452.360532:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100143104:0@lo:256: 00000100:00100000:0.0:1782727452.360567:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.360593:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae18250d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782727452.360865:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100143104 00000100:00100000:1.0:1782727452.360871:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100143104 00000100:00100000:1.0:1782727452.360916:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782727452.360923:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100143104:12345-0@lo:256: 20000000:01000000:1.0:1782727452.360951:0:5944:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782727452.360978:0:5944:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782727452.360982:0:5944:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1782727452.361063:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100143104:12345-0@lo:256: Request processed in 141us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727452.361071:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782727452.361115:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100143104:0@lo:256: 10000000:01000000:1.0:1782727452.361160:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782727452.361169:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae00030200/0x8db73d43f55048e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55048ee expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727452.361177:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae00030200/0x8db73d43f55048e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55048ee expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727452.361186:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1782727452.361189:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1782727452.361191:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1782727452.361241:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55048f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727452.361249:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55048f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727452.361257:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55048f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727452.361547:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100143232:0@lo:101: 00000100:00100000:1.0:1782727452.361581:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727452.361613:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0f55c480 going to sleep for 11 seconds 00000100:00100000:1.0:1782727452.361634:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100143232 00000100:00100000:1.0:1782727452.361638:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100143232 00000100:00100000:1.0:1782727452.361665:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782727452.361671:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100143232:12345-0@lo:101: 00010000:00010000:1.0:1782727452.361680:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727452.361694:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae37da7400/0x8db73d43f55048fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f55048f5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727452.361713:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae37da7400/0x8db73d43f55048fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f55048f5 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727452.361794:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae37da7400/0x8db73d43f55048fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55048f5 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727452.361806:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae37da7400, rc 0) 00000100:00100000:1.0:1782727452.361839:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100143232:12345-0@lo:101: Request processed in 167us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727452.361845:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782727452.361882:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100143232:0@lo:101: 00010000:00010000:1.0:1782727452.361903:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55048f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55048fc expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727452.361913:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55048f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f55048fc expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727452.362161:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100143360:0@lo:501: 00000100:00100000:1.0:1782727452.362187:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727452.362213:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0f55c480 going to sleep for 11 seconds 00000100:00100000:0.0:1782727452.362603:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100143360 00000100:00100000:0.0:1782727452.362611:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100143360 00000100:00100000:0.0:1782727452.362656:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782727452.362675:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100143360:12345-0@lo:501: 00000100:00100000:0.0:1782727452.363533:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100143360:12345-0@lo:501: Request processed in 854us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727452.363543:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1782727452.363641:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100143360:0@lo:501: 00000100:00100000:1.0:1782727452.363706:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100143488:0@lo:503: 00000100:00100000:0.0:1782727452.365552:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.365606:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0f55c480 going to sleep for 11 seconds 00000100:00100000:1.0:1782727452.365842:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100143488 00000100:00100000:1.0:1782727452.365854:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100143488 00000100:00100000:1.0:1782727452.366919:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782727452.366935:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100143488:12345-0@lo:503: 00000100:00100000:0.0:1782727452.367632:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100143488:12345-0@lo:503: Request processed in 697us (2085us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727452.367645:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782727452.367914:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100143488:0@lo:503: 00000100:00100000:1.0:1782727452.369626:0:8486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f52300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8486:1869325100143616:0@lo:502: 00000100:00100000:1.0:1782727452.370830:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.371044:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100143616 00000100:00100000:0.0:1782727452.371056:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100143616 00000100:00100000:0.0:1782727452.371199:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782727452.371211:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:8486:x1869325100143616:12345-0@lo:502: 00000100:00100000:0.0:1782727452.372241:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:8486:x1869325100143616:12345-0@lo:502: Request processed in 1027us (2510us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727452.372254:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782727452.372423:0:8486:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0f55c000 going to sleep for 11 seconds 00000100:00100000:1.0:1782727452.372460:0:8486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f52300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8486:1869325100143616:0@lo:502: 00000020:01000000:1.0:1782727452.372514:0:8486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782727452.372525:0:8486:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1782727452.372536:0:8486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727452.372539:0:8486:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1782727452.372546:0:8486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782727452.372551:0:8486:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:1.0:1782727452.372583:0:8486:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1782727452.372587:0:8486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782727452.372624:0:8486:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90ae3b3319d0) 00000020:00000080:1.0:1782727452.372653:0:8486:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1782727452.372661:0:8486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782727452.373579:0:8486:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1782727452.373589:0:8486:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1782727452.373602:0:8486:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8db73d43f550490a 00010000:00080000:1.0:1782727452.373646:0:8486:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90ae2f38d000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:0.0:1782727452.378655:0:8486:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1782727452.378849:0:8486:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1782727452.378868:0:8486:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1782727452.379117:0:8486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782727452.379296:0:8486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782727452.379502:0:8486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1782727452.379595:0:8486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1782727452.383318:0:8487:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782727452.383328:0:8487:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1782727452.384356:0:8486:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782727452.384513:0:8486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1782727452.384566:0:8486:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1782727452.384595:0:8486:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8db73d43f5504911 00000100:00080000:0.0:1782727452.384609:0:8486:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782727452.384615:0:8486:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90ae2f38d000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1782727452.384671:0:8486:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90ae0f7d4000 x1869325100143744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782727452.384933:0:3442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3442:1869325100143744:0@lo:8: 00000100:00100000:3.0:1782727452.385033:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782727452.385111:0:8486:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1782727452.385216:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325100144000:0@lo:400: 00000100:00100000:0.0:1782727452.385253:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.385280:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727452.385286:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325100143872:0@lo:400: 00000100:00100000:0.0:1782727452.385326:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.385356:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100144128:0@lo:400: 00000100:00100000:0.0:1782727452.385415:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.385434:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727452.385438:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325100144256:0@lo:400: 00000100:00100000:0.0:1782727452.385460:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.385495:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100144000 00000100:00100000:0.0:1782727452.385506:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100144000 00000100:00100000:0.0:1782727452.385560:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100143872 00000100:00100000:0.0:1782727452.385564:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100143872 00000100:00100000:0.0:1782727452.385577:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100144256 00000100:00100000:0.0:1782727452.385579:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100144256 00000100:00100000:0.0:1782727452.385597:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782727452.385606:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325100144000:12345-0@lo:400: 00000100:00100000:0.0:1782727452.385675:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325100144000:12345-0@lo:400: Request processed in 69us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727452.385683:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782727452.385703:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782727452.385709:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3daf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325100143872:12345-0@lo:400: 00000100:00100000:0.0:1782727452.385738:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3daf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325100143872:12345-0@lo:400: Request processed in 29us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727452.385752:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782727452.385764:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782727452.385770:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dafb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325100144256:12345-0@lo:400: 00000100:00100000:0.0:1782727452.385803:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dafb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325100144256:12345-0@lo:400: Request processed in 33us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727452.385809:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782727452.385828:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100143744 00000100:00100000:0.0:1782727452.385831:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100143744 00000100:00100000:0.0:1782727452.385850:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100144128 00000100:00100000:0.0:1782727452.385853:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100144128 00000100:00100000:0.0:1782727452.385874:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782727452.385880:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3daf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100144128:12345-0@lo:400: 00000100:00100000:0.0:1782727452.385926:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3daf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100144128:12345-0@lo:400: Request processed in 46us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727452.385933:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782727452.385945:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782727452.385949:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3442:x1869325100143744:12345-0@lo:8: 00010000:00080000:0.0:1782727452.385975:0:6940:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:0.0:1782727452.386007:0:6940:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8db73d43f5504918 00002000:00100000:0.0:1782727452.386025:0:6940:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90ae3ddfa000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1782727452.386030:0:6940:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1782727452.386034:0:6940:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1782727452.386123:0:6940:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1782727452.386495:0:6940:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782727452.386528:0:6940:0:(import.c:65:import_set_state_nolock()) ffff90ae3d89f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782727452.390432:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3442:x1869325100143744:12345-0@lo:8: Request processed in 4464us (5383us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727452.390470:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1782727452.390574:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae0f7d4700 x1869325100144256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727452.390596:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325100144256:0@lo:400: 00010000:00080000:0.0:1782727452.390614:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae0f7d5880 x1869325100144128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727452.390624:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100144128:0@lo:400: 00010000:00080000:0.0:1782727452.390674:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae0f7d7100 x1869325100143872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727452.390684:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325100143872:0@lo:400: 00010000:00080000:0.0:1782727452.390697:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae0f7d6a00 x1869325100144000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727452.390705:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325100144000:0@lo:400: 00000020:01000000:0.0:1782727452.390824:0:8486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727452.390835:0:8486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727452.390838:0:8486:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1782727452.390841:0:8486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727452.390847:0:8486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727452.390848:0:8486:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782727452.390851:0:8486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782727452.390853:0:8486:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1782727452.390921:0:8486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dafa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8486:1869325100144384:0@lo:502: 00000100:00100000:0.0:1782727452.391017:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.391057:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100144384 00000100:00100000:0.0:1782727452.391065:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100144384 00000100:00100000:0.0:1782727452.391122:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782727452.391130:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:8486:x1869325100144384:12345-0@lo:502: 00000100:00100000:0.0:1782727452.391272:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:8486:x1869325100144384:12345-0@lo:502: Request processed in 142us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727452.391280:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782727452.391343:0:8486:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae18250a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782727452.391358:0:8486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dafa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8486:1869325100144384:0@lo:502: 00010000:00080000:3.0:1782727452.392128:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae0f7d4000 x1869325100143744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782727462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727452.392142:0:3442:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782727452.392153:0:3442:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1782727452.392162:0:3442:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1782727452.392170:0:3442:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1782727452.392174:0:3442:0:(import.c:65:import_set_state_nolock()) ffff90ae2f38d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1782727452.392237:0:3442:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1782727452.392245:0:3442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3442:1869325100143744:0@lo:8: 00000004:00080000:3.0:1782727452.392277:0:8487:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782727452.392394:0:8487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 176674020185ns, next at 0ns, rc = 0 00080000:00080000:3.0:1782727452.392402:0:8487:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:3.0:1782727452.392431:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782727452.392438:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:0.0:1782727452.392863:0:8486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727452.392873:0:8486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727452.392876:0:8486:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782727452.392882:0:8486:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1782727452.393555:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1782727452.393587:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782727452.393601:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55048f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55048fc expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727452.393615:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55048f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55048fc expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727452.393647:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782727452.393650:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff90ae0f4f0000 from 1 10000000:01000000:3.0:1782727452.393653:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782727452.393694:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae01539a00/0x8db73d43f550491f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727452.393702:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae01539a00/0x8db73d43f550491f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727452.393713:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae01539a00/0x8db73d43f550491f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727452.393739:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100144512:0@lo:101: 00000100:00100000:3.0:1782727452.393822:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727452.393871:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae37e380c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727452.394401:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100144512 00000100:00100000:0.0:1782727452.394413:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100144512 00000100:00100000:0.0:1782727452.394474:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782727452.394484:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100144512:12345-0@lo:101: 00010000:00010000:0.0:1782727452.394504:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727452.394522:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae00031600/0x8db73d43f5504926 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f550491f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727452.394553:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae00031600/0x8db73d43f5504926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f550491f expref: 19 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727452.394565:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae00031600/0x8db73d43f5504926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f550491f expref: 19 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727452.394575:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae00031600, rc 0) 00000100:00100000:0.0:1782727452.394631:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:5949:x1869325100144512:12345-0@lo:101: Request processed in 148us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727452.394639:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782727452.394702:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100144512:0@lo:101: 00010000:00010000:0.0:1782727452.394720:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae01539a00/0x8db73d43f550491f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504926 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727452.394731:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae01539a00/0x8db73d43f550491f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f5504926 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727452.395422:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dafa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100144640:0@lo:501: 00000100:00100000:0.0:1782727452.395473:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.395506:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae18250e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782727452.395632:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100144640 00000100:00100000:0.0:1782727452.395638:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100144640 00000100:00100000:0.0:1782727452.395671:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782727452.395680:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:5949:x1869325100144640:12345-0@lo:501: 00000100:00100000:0.0:1782727452.395784:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:5949:x1869325100144640:12345-0@lo:501: Request processed in 104us (311us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782727452.395792:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782727452.395835:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dafa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100144640:0@lo:501: 10000000:01000000:0.0:1782727452.395866:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782727452.395875:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae01539a00/0x8db73d43f550491f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504926 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727452.395885:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae01539a00/0x8db73d43f550491f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504926 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782727452.397276:0:5931:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1782727452.403337:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:2.0:1782727452.403443:0:8488:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1782727452.403485:0:8488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ef800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8488:1869325100144896:0@lo:7: 00000100:00100000:2.0:1782727452.403589:0:8488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727452.403639:0:8488:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b3ceb40 going to sleep for 11 seconds 00000100:00100000:3.0:1782727452.403710:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100144896 00000100:00100000:3.0:1782727452.403722:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100144896 00000100:00100000:3.0:1782727452.403808:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782727452.403821:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8488:x1869325100144896:12345-0@lo:7: 00000100:00080000:2.0:1782727452.408055:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727452.408433:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100144768:0@lo:13: 00000100:00100000:0.0:1782727452.408552:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.408619:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100144768 00000100:00100000:0.0:1782727452.408630:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100144768 00000100:00100000:0.0:1782727452.408691:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782727452.408716:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dafa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3444:x1869325100144768:12345-0@lo:13: 00002000:00000024:0.0:1782727452.408757:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923836928 avail 3692314624 00000100:00100000:0.0:1782727452.408813:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dafa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3444:x1869325100144768:12345-0@lo:13: Request processed in 99us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727452.408822:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1782727452.408874:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b0ed880 x1869325100144768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727452.408910:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100144768:0@lo:13: 00002000:00080000:3.0:1782727452.410861:0:6941:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1782727452.410871:0:6941:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1782727452.411361:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8488:x1869325100144896:12345-0@lo:7: Request processed in 7536us (7766us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727452.411403:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1782727452.411665:0:8488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b0ef800 x1869325100144896/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782727468 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727452.411714:0:8488:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ef800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8488:1869325100144896:0@lo:7: 00000004:00080000:2.0:1782727452.411733:0:8488:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1782727452.411793:0:8488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ef800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8488:1869325100145024:0@lo:5: 00000100:00100000:2.0:1782727452.411835:0:8488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727452.411880:0:8488:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b3ceb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782727452.412047:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100145024 00000100:00100000:0.0:1782727452.412055:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100145024 00000100:00100000:0.0:1782727452.412148:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782727452.412159:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8488:x1869325100145024:12345-0@lo:5: 00002000:00080000:0.0:1782727452.412191:0:6940:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1782727452.412197:0:6940:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1782727452.416260:0:8009:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1782727452.416282:0:8009:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1782727452.416582:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8488:x1869325100145024:12345-0@lo:5: Request processed in 4414us (4735us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1782727452.416597:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1782727452.416752:0:8488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b0ef800 x1869325100145024/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782727468 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727452.416775:0:8488:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1782727452.416784:0:8488:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ef800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8488:1869325100145024:0@lo:5: 00000004:00080000:0.0:1782727452.416812:0:8488:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1782727452.417049:0:8488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dafb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8488:1869325100145152:0@lo:700: 00000100:00100000:0.0:1782727452.417114:0:8488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727452.417168:0:8488:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae18250e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782727452.417171:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100145152 00000100:00100000:3.0:1782727452.417181:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100145152 00000100:00100000:3.0:1782727452.417280:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782727452.417292:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3daf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8488:x1869325100145152:12345-0@lo:700: 00000100:00100000:3.0:1782727452.417348:0:6947:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6947:1869325100145280:0@lo:700: 00000100:00100000:3.0:1782727452.417422:0:6947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727452.417446:0:6947:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae37e38e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782727452.417483:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100145280 00000100:00100000:0.0:1782727452.417487:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100145280 00000100:00100000:0.0:1782727452.417525:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782727452.417533:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6947:x1869325100145280:12345-0@lo:700: 40000000:02000000:2.0:1782727452.431625:0:5959:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00010000:00080000:3.0:1782727452.442055:0:6947:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae035bc000 x1869325100145280/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782727468 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727452.442078:0:6947:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6947:1869325100145280:0@lo:700: 40000000:02000000:3.0:1782727452.442095:0:6947:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1782727452.442700:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6947:x1869325100145280:12345-0@lo:700: Request processed in 24427us (24546us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727452.442792:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782727452.466731:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3daf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8488:x1869325100145152:12345-0@lo:700: Request processed in 49426us (49601us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727452.466752:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782727452.466871:0:8488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3dafb480 x1869325100145152/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782727468 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727452.466889:0:8488:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dafb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8488:1869325100145152:0@lo:700: 00000004:02000040:2.0:1782727452.476229:0:8488:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1782727452.485957:0:8488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ef800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8488:1869325100145408:0@lo:5: 00000100:00100000:2.0:1782727452.486049:0:8488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727452.486172:0:8488:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b3ce780 going to sleep for 11 seconds 00000100:00100000:3.0:1782727452.486885:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100145408 00000100:00100000:3.0:1782727452.486906:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100145408 00000100:00100000:3.0:1782727452.487049:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782727452.487063:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8488:x1869325100145408:12345-0@lo:5: 00002000:00080000:3.0:1782727452.494134:0:6941:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1782727452.494223:0:6941:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1782727452.497620:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8488:x1869325100145408:12345-0@lo:5: Request processed in 10550us (11561us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1782727452.497638:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1782727452.497838:0:8488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b0ef800 x1869325100145408/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782727468 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727452.497861:0:8488:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ef800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8488:1869325100145408:0@lo:5: 00000004:00080000:2.0:1782727452.497881:0:8488:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1782727452.712961:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782727453.226569:0:8526:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782727453.227573:0:8526:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782727453.735208:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782727454.367773:0:8574:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782727454.367788:0:8574:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1782727454.757619:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727455.783614:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727455.909649:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100145536:0@lo:13: 00000100:00100000:0.0:1782727455.909731:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727455.909932:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100145536 00000100:00100000:2.0:1782727455.909939:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100145536 00000100:00100000:2.0:1782727455.910015:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782727455.910025:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dafb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100145536:12345-0@lo:13: 00002000:00000024:2.0:1782727455.910058:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727455.910101:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dafb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100145536:12345-0@lo:13: Request processed in 78us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727455.910108:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1782727455.910211:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782727455.910246:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b0eea00 x1869325100145536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727455.910264:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100145536:0@lo:13: 00000100:00100000:1.0:1782727455.918705:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727455.919293:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080199552 00000100:00100000:0.0:1782727455.919304:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080199552 00000100:00100000:0.0:1782727455.919365:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 111 00000100:00100000:0.0:1782727455.919437:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2349:x1869325080199552:12345-192.168.204.35@tcp:250: 00010000:00080000:0.0:1782727455.919466:0:5944:0:(ldlm_lib.c:1434:target_handle_connect()) MGS: connection from b67c46fe-bdce-4fa5-ac17-5bb374207e90@192.168.204.35@tcp t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:0.0:1782727455.919503:0:5944:0:(genops.c:1406:class_connect()) connect: client b67c46fe-bdce-4fa5-ac17-5bb374207e90, cookie 0x8db73d43f550492d 00000100:00080000:0.0:1782727455.919643:0:5944:0:(import.c:65:import_set_state_nolock()) ffff90ae3d89a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782727455.919734:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+5:2349:x1869325080199552:12345-192.168.204.35@tcp:250: Request processed in 348us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727455.919743:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 111 00000100:00100000:1.0:1782727455.922679:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727455.922807:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080199424 00000100:00100000:3.0:1782727455.922817:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080199424 00000100:00100000:3.0:1782727455.922896:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 112 00000100:00100000:3.0:1782727455.922906:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+5:5427:x1869325080199424:12345-192.168.204.35@tcp:101: 00010000:00010000:3.0:1782727455.922925:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727455.922942:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae01538a00/0x8db73d43f5504934 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cd528c397357763 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727455.923001:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae01538a00/0x8db73d43f5504934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357763 expref: 6 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727455.923021:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae01538a00/0x8db73d43f5504934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357763 expref: 6 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727455.923032:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae01538a00, rc 0) 00000100:00100000:3.0:1782727455.923097:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+6:5427:x1869325080199424:12345-192.168.204.35@tcp:101: Request processed in 192us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727455.923104:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 112 00000100:00100000:1.0:1782727455.937212:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727455.938698:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080199680 00000100:00100000:2.0:1782727455.938712:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080199680 00000100:00100000:2.0:1782727455.938791:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 113 00000100:00100000:2.0:1782727455.938800:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+6:5427:x1869325080199680:12345-192.168.204.35@tcp:501: 00000100:00100000:2.0:1782727455.938931:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+6:5427:x1869325080199680:12345-192.168.204.35@tcp:501: Request processed in 131us (1731us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782727455.938939:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 113 00000100:00100000:0.0:1782727455.947782:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727455.947887:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080199808 00000100:00100000:2.0:1782727455.947897:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080199808 00000100:00100000:2.0:1782727455.947961:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 114 00000100:00100000:2.0:1782727455.947972:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+6:5427:x1869325080199808:12345-192.168.204.35@tcp:101: 00010000:00010000:2.0:1782727455.947989:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727455.948007:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae0a3c7600/0x8db73d43f550493b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cd528c39735776a expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.948049:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae0a3c7600/0x8db73d43f550493b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735776a expref: 7 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.948061:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae0a3c7600/0x8db73d43f550493b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735776a expref: 7 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727455.948091:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae0a3c7600, rc 0) 00000100:00100000:2.0:1782727455.948157:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+7:5427:x1869325080199808:12345-192.168.204.35@tcp:101: Request processed in 186us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727455.948164:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 114 00000100:00100000:1.0:1782727455.950961:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727455.951068:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080199936 00000100:00100000:3.0:1782727455.951077:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080199936 00000100:00100000:3.0:1782727455.951135:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 115 00000100:00100000:3.0:1782727455.951144:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+7:5427:x1869325080199936:12345-192.168.204.35@tcp:501: 00000100:00100000:3.0:1782727455.951313:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+8:5427:x1869325080199936:12345-192.168.204.35@tcp:501: Request processed in 169us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727455.951323:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 115 00000100:00100000:1.0:1782727455.954429:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727455.954654:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080200064 00000100:00100000:0.0:1782727455.954664:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080200064 00000100:00100000:0.0:1782727455.954733:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 116 00000100:00100000:0.0:1782727455.954743:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+8:5427:x1869325080200064:12345-192.168.204.35@tcp:503: 00000100:00100000:0.0:1782727455.955039:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+8:5427:x1869325080200064:12345-192.168.204.35@tcp:503: Request processed in 295us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727455.955047:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 116 00000100:00100000:0.0:1782727455.958617:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727455.961886:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080200192 00000100:00100000:2.0:1782727455.961900:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080200192 00000100:00100000:2.0:1782727455.962059:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 117 00000100:00100000:2.0:1782727455.962072:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+8:5446:x1869325080200192:12345-192.168.204.35@tcp:502: 00000100:00100000:2.0:1782727455.962255:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+8:5446:x1869325080200192:12345-192.168.204.35@tcp:502: Request processed in 185us (3649us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727455.962265:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 117 00000100:00100000:1.0:1782727456.011978:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727456.012137:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080200320 00000100:00100000:0.0:1782727456.012148:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080200320 00000100:00100000:0.0:1782727456.012211:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 118 00000100:00100000:0.0:1782727456.012222:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+8:5446:x1869325080200320:12345-192.168.204.35@tcp:502: 00000100:00100000:0.0:1782727456.012422:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+8:5446:x1869325080200320:12345-192.168.204.35@tcp:502: Request processed in 201us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727456.012431:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 118 00000100:00100000:1.0:1782727456.020256:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727456.020561:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080200448 00000100:00100000:2.0:1782727456.020571:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080200448 00000100:00100000:2.0:1782727456.020634:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 119 00000100:00100000:2.0:1782727456.020645:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+8:5427:x1869325080200448:12345-192.168.204.35@tcp:101: 00010000:00010000:2.0:1782727456.020666:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727456.020684:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae0a3c6400/0x8db73d43f5504942 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cd528c397357794 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727456.020714:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae0a3c6400/0x8db73d43f5504942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357794 expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727456.020726:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae0a3c6400/0x8db73d43f5504942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357794 expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727456.020734:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae0a3c6400, rc 0) 00000100:00100000:2.0:1782727456.021118:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+9:5427:x1869325080200448:12345-192.168.204.35@tcp:101: Request processed in 471us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727456.021127:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 119 00000100:00100000:1.0:1782727456.028217:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727456.028314:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080200576 00000100:00100000:3.0:1782727456.028325:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080200576 00000100:00100000:3.0:1782727456.028591:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 120 00000100:00100000:3.0:1782727456.028603:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+9:5427:x1869325080200576:12345-192.168.204.35@tcp:256: 20000000:01000000:3.0:1782727456.028633:0:5947:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1782727456.028660:0:5947:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1782727456.028665:0:5947:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1782727456.028667:0:5947:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1782727456.028670:0:5947:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1782727456.031909:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+9:5427:x1869325080200576:12345-192.168.204.35@tcp:256: Request processed in 3298us (3693us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727456.031925:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 120 00000100:00100000:1.0:1782727456.037704:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727456.038307:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080200704 00000100:00100000:2.0:1782727456.038320:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080200704 00000100:00100000:2.0:1782727456.038429:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 121 00000100:00100000:2.0:1782727456.038440:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+9:5427:x1869325080200704:12345-192.168.204.35@tcp:101: 00010000:00010000:2.0:1782727456.038457:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727456.038483:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae0a3c6c00/0x8db73d43f5504949 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cd528c39735779b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727456.038513:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae0a3c6c00/0x8db73d43f5504949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735779b expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727456.038523:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae0a3c6c00/0x8db73d43f5504949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735779b expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727456.038533:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae0a3c6c00, rc 0) 00000100:00100000:2.0:1782727456.038593:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5427:x1869325080200704:12345-192.168.204.35@tcp:101: Request processed in 155us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727456.038599:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 121 00000100:00100000:1.0:1782727456.041172:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727456.041310:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080200832 00000100:00100000:3.0:1782727456.041320:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080200832 00000100:00100000:3.0:1782727456.041434:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 122 00000100:00100000:3.0:1782727456.041445:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5427:x1869325080200832:12345-192.168.204.35@tcp:501: 00000100:00100000:3.0:1782727456.041815:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5427:x1869325080200832:12345-192.168.204.35@tcp:501: Request processed in 372us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727456.041835:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 122 00000100:00100000:2.0:1782727456.066493:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727456.066708:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080200960 00000100:00100000:0.0:1782727456.066719:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080200960 00000100:00100000:0.0:1782727456.067039:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 123 00000100:00100000:0.0:1782727456.067050:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5427:x1869325080200960:12345-192.168.204.35@tcp:503: 00000100:00100000:0.0:1782727456.067223:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5427:x1869325080200960:12345-192.168.204.35@tcp:503: Request processed in 174us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727456.067232:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 123 00000100:00100000:1.0:1782727456.071071:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727456.071210:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080201088 00000100:00100000:3.0:1782727456.071221:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080201088 00000100:00100000:3.0:1782727456.071282:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 124 00000100:00100000:3.0:1782727456.071292:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5451:x1869325080201088:12345-192.168.204.35@tcp:502: 00000100:00100000:3.0:1782727456.071572:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5451:x1869325080201088:12345-192.168.204.35@tcp:502: Request processed in 281us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727456.071581:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 124 00000100:00100000:1.0:1782727456.073278:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727456.073366:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080201216 00000100:00100000:2.0:1782727456.073415:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080201216 00000100:00100000:2.0:1782727456.073544:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 125 00000100:00100000:2.0:1782727456.073557:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5451:x1869325080201216:12345-192.168.204.35@tcp:502: 00000100:00100000:2.0:1782727456.073943:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5451:x1869325080201216:12345-192.168.204.35@tcp:502: Request processed in 169us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727456.073964:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 125 00000100:00100000:2.0:1782727456.081952:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727456.082175:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080201344 00000100:00100000:0.0:1782727456.082188:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080201344 00000100:00100000:0.0:1782727456.082247:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4 00000100:00100000:0.0:1782727456.082256:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2349:x1869325080201344:12345-192.168.204.35@tcp:38: 00010000:00080000:0.0:1782727456.082306:0:5953:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-MDT0000: connection from f875d55c-258d-46bd-8e2e-5a5be22638df@192.168.204.35@tcp t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:0.0:1782727456.082356:0:5953:0:(genops.c:1406:class_connect()) connect: client f875d55c-258d-46bd-8e2e-5a5be22638df, cookie 0x8db73d43f5504950 00000004:00100000:0.0:1782727456.082424:0:5953:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1782727456.082431:0:5953:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1782727456.090673:0:5953:0:(import.c:65:import_set_state_nolock()) ffff90ae3d89d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782727456.091161:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2349:x1869325080201344:12345-192.168.204.35@tcp:38: Request processed in 8902us (9220us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727456.091175:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4 00010000:00010000:2.0:1782727456.805574:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727457.119762:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727457.119823:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727457.120425:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080201600 00000100:00100000:2.0:1782727457.120435:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080201600 00000100:00100000:2.0:1782727457.120509:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080201472 00000100:00100000:2.0:1782727457.120512:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080201472 00000100:00100000:2.0:1782727457.120531:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:2.0:1782727457.120541:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+7:5427:x1869325080201600:12345-192.168.204.35@tcp:41: 00000004:00000024:2.0:1782727457.120584:0:5952:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:2.0:1782727457.120659:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+7:5427:x1869325080201600:12345-192.168.204.35@tcp:41: Request processed in 120us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727457.120667:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:2.0:1782727457.120685:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:2.0:1782727457.120691:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:0:x1869325080201472:12345-192.168.204.35@tcp:41: 00000004:00000024:2.0:1782727457.120705:0:5952:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:2.0:1782727457.120726:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:0:x1869325080201472:12345-192.168.204.35@tcp:41: Request processed in 35us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727457.120732:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00080000:1.0:1782727457.121012:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727457.126952:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727457.127128:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080201728 00000100:00100000:3.0:1782727457.127138:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080201728 00000100:00100000:3.0:1782727457.127239:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:3.0:1782727457.127251:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:5427:x1869325080201728:12345-192.168.204.35@tcp:40: 00000100:00100000:3.0:1782727457.127355:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:5427:x1869325080201728:12345-192.168.204.35@tcp:40: Request processed in 107us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727457.127364:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:2.0:1782727457.134486:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727457.134541:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727457.134610:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727457.134728:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080201856 00000100:00100000:1.0:1782727457.134739:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080201856 00000100:00100000:1.0:1782727457.134782:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080201984 00000100:00100000:1.0:1782727457.134786:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080201984 00000100:00100000:1.0:1782727457.134811:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:1.0:1782727457.134820:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1869325080201856:12345-192.168.204.35@tcp:8: 00010000:00080000:1.0:1782727457.134853:0:6939:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0000: connection from f875d55c-258d-46bd-8e2e-5a5be22638df@192.168.204.35@tcp t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:1.0:1782727457.134883:0:6939:0:(genops.c:1406:class_connect()) connect: client f875d55c-258d-46bd-8e2e-5a5be22638df, cookie 0x8db73d43f5504957 00002000:00100000:1.0:1782727457.134895:0:6939:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f875d55c-258d-46bd-8e2e-5a5be22638df/ffff90ae3df8a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782727457.134906:0:6939:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782727457.135099:0:6939:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782727457.135136:0:6939:0:(import.c:65:import_set_state_nolock()) ffff90ae3df8f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782727457.135199:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2349:x1869325080201856:12345-192.168.204.35@tcp:8: Request processed in 379us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727457.135206:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:1.0:1782727457.135222:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:1.0:1782727457.135226:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1869325080201984:12345-192.168.204.35@tcp:8: 00010000:00080000:1.0:1782727457.135240:0:6939:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0001: connection from f875d55c-258d-46bd-8e2e-5a5be22638df@192.168.204.35@tcp t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:1.0:1782727457.135256:0:6939:0:(genops.c:1406:class_connect()) connect: client f875d55c-258d-46bd-8e2e-5a5be22638df, cookie 0x8db73d43f550495e 00002000:00100000:1.0:1782727457.135261:0:6939:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f875d55c-258d-46bd-8e2e-5a5be22638df/ffff90ae3df8e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782727457.135274:0:6939:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782727457.135405:0:6939:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782727457.135421:0:6939:0:(import.c:65:import_set_state_nolock()) ffff90ae3df8d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782727457.135446:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2349:x1869325080201984:12345-192.168.204.35@tcp:8: Request processed in 217us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727457.135453:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:0.0:1782727457.135752:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080202240 00000100:00100000:0.0:1782727457.135758:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080202240 00000100:00100000:0.0:1782727457.135816:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 126 00000100:00100000:0.0:1782727457.135823:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2351:x1869325080202240:12345-192.168.204.35@tcp:400: 00000100:00100000:0.0:1782727457.135863:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2351:x1869325080202240:12345-192.168.204.35@tcp:400: Request processed in 41us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727457.135870:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 126 00000100:00100000:2.0:1782727457.143424:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727457.143613:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080202112 00000100:00100000:3.0:1782727457.143623:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080202112 00000100:00100000:3.0:1782727457.143700:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00100000:3.0:1782727457.143711:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:5427:x1869325080202112:12345-192.168.204.35@tcp:33: 00000004:00080000:3.0:1782727457.172166:0:5955:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 28367us 00000004:00200000:1.0:1782727457.194127:0:5955:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1782727457.194248:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:5427:x1869325080202112:12345-192.168.204.35@tcp:33: Request processed in 50533us (50829us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727457.194263:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00100000:0.0:1782727457.406335:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727457.406621:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080202368 00000100:00100000:2.0:1782727457.406632:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080202368 00000100:00100000:2.0:1782727457.406696:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:2.0:1782727457.406723:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3daf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+6:5468:x1869325080202368:12345-192.168.204.35@tcp:101: 00010000:00010000:2.0:1782727457.406744:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727457.406770:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae0a3c6600/0x8db73d43f5504965 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c3973577c5 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727457.406846:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae0a3c7e00/0x8db73d43f550496c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727457.406860:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae0a3c7e00/0x8db73d43f550496c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727457.406873:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae0a3c7e00/0x8db73d43f550496c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727457.406935:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782727457.406939:0:5953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727457.406955:0:5953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ae0a3c7e00/0x8db73d43f550496c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727457.407078:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae0a3c6600/0x8db73d43f5504965 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577c5 expref: 8 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727457.407102:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae0a3c7e00/0x8db73d43f550496c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577c5 expref: 7 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727457.407111:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3b217c00) 00010000:00010000:2.0:1782727457.407114:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782727457.407118:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae0a3c7e00, rc 0) 00000100:00100000:2.0:1782727457.407187:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3daf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+7:5468:x1869325080202368:12345-192.168.204.35@tcp:101: Request processed in 466us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727457.407204:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:0.0:1782727457.445788:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dafaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100145664:0@lo:400: 00000100:00100000:0.0:1782727457.445883:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727457.445940:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3daf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325100146176:0@lo:400: 00000100:00100000:0.0:1782727457.445985:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727457.446012:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782727457.446018:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3daf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325100145792:0@lo:400: 00000100:00100000:0.0:1782727457.446069:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727457.446087:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3daf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100146304:0@lo:400: 00000100:00100000:0.0:1782727457.446112:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727457.446150:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3daf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100146048:0@lo:400: 00000100:00100000:0.0:1782727457.446174:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727457.446193:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727457.446199:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dafb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325100145920:0@lo:400: 00000100:00100000:0.0:1782727457.446219:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727457.446245:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100146304 00000100:00100000:0.0:1782727457.446251:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100146304 00000100:00100000:1.0:1782727457.446433:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100146432:0@lo:13: 00000100:00100000:1.0:1782727457.446467:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727457.446495:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100146048 00000100:00100000:1.0:1782727457.446499:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100146048 00000100:00100000:1.0:1782727457.446532:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782727457.446541:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dafa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100146048:12345-0@lo:400: 00000100:00100000:1.0:1782727457.446605:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dafa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100146048:12345-0@lo:400: Request processed in 64us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727457.446620:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1782727457.446641:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782727457.446645:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782727457.446657:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100146432 00000100:00100000:1.0:1782727457.446660:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100146432 00000100:00100000:0.0:1782727457.446865:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782727457.446873:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dafad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3445:x1869325100146304:12345-0@lo:400: 00000100:00100000:1.0:1782727457.450013:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782727457.450037:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3443:x1869325100146432:12345-0@lo:13: 00002000:00000024:1.0:1782727457.450066:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727457.450151:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3443:x1869325100146432:12345-0@lo:13: Request processed in 125us (3682us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727457.450160:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782727457.450212:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100146176 00000100:00100000:3.0:1782727457.450221:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100146176 00010000:00080000:1.0:1782727457.450241:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae37f51880 x1869325100146432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727457.450266:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100146432:0@lo:13: 00000100:00100000:3.0:1782727457.450272:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100145792 00000100:00100000:3.0:1782727457.450277:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100145792 00000100:00100000:3.0:1782727457.450292:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100145920 00000100:00100000:3.0:1782727457.450295:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100145920 00000100:00100000:3.0:1782727457.450311:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782727457.450319:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3daf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325100146176:12345-0@lo:400: 00000100:00100000:3.0:1782727457.450369:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3daf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325100146176:12345-0@lo:400: Request processed in 51us (4383us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727457.450392:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782727457.450406:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782727457.450412:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3daf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325100145792:12345-0@lo:400: 00000100:00100000:3.0:1782727457.450444:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3daf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325100145792:12345-0@lo:400: Request processed in 32us (4374us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727457.450451:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782727457.450466:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782727457.450475:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dafbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325100145920:12345-0@lo:400: 00010000:00080000:1.0:1782727457.450487:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3daf8a80 x1869325100146048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727457.450498:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3daf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100146048:0@lo:400: 00000100:00100000:3.0:1782727457.450511:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dafbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325100145920:12345-0@lo:400: Request processed in 37us (4288us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727457.450519:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782727457.450528:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dafb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325100145920:0@lo:400: 00000100:00080000:3.0:1782727457.450538:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727457.450566:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3daf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325100145792:0@lo:400: 00000100:00100000:3.0:1782727457.450583:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3daf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325100146176:0@lo:400: 00000100:00100000:1.0:1782727457.450605:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100145664 00000100:00100000:1.0:1782727457.450611:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100145664 00000100:00100000:1.0:1782727457.450646:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1782727457.450654:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3445:x1869325100145664:12345-0@lo:400: 00000100:00100000:1.0:1782727457.450704:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3445:x1869325100145664:12345-0@lo:400: Request processed in 50us (4821us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727457.450710:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1782727457.450869:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dafaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100145664:0@lo:400: 00000100:00100000:0.0:1782727457.452125:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dafad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3445:x1869325100146304:12345-0@lo:400: Request processed in 5247us (6006us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727457.452137:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1782727457.452151:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3daf8000 x1869325100146304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727457.452168:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3daf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100146304:0@lo:400: 00010000:00010000:3.0:1782727457.830101:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782727458.475834:0:8009:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f875d55c-258d-46bd-8e2e-5a5be22638df 00000001:00080000:0.0:1782727458.475852:0:8009:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1782727458.853625:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727459.394350:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727459.394525:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080202496 00000100:00100000:3.0:1782727459.394536:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080202496 00000100:00080000:1.0:1782727459.394668:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727459.394957:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:3.0:1782727459.394971:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+7:5520:x1869325080202496:12345-192.168.204.35@tcp:41: 00000004:00000024:3.0:1782727459.395245:0:5952:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:3.0:1782727459.395332:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+7:5520:x1869325080202496:12345-192.168.204.35@tcp:41: Request processed in 364us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727459.395340:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:2.0:1782727459.400722:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727459.401898:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080202624 00000100:00100000:1.0:1782727459.401911:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080202624 00000100:00080000:3.0:1782727459.402345:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727459.402424:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:1.0:1782727459.402437:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f875d55c-258d-46bd-8e2e-5a5be22638df+6:5520:x1869325080202624:12345-192.168.204.35@tcp:13: 00002000:00000024:1.0:1782727459.402477:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727459.402574:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f875d55c-258d-46bd-8e2e-5a5be22638df+6:5520:x1869325080202624:12345-192.168.204.35@tcp:13: Request processed in 139us (1864us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727459.402584:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:1.0:1782727459.409888:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727459.410436:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080202752 00000100:00100000:2.0:1782727459.410448:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080202752 00000100:00100000:2.0:1782727459.410527:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:2.0:1782727459.410540:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f875d55c-258d-46bd-8e2e-5a5be22638df+5:5520:x1869325080202752:12345-192.168.204.35@tcp:13: 00002000:00000024:2.0:1782727459.410581:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00080000:3.0:1782727459.410792:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782727459.411496:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f875d55c-258d-46bd-8e2e-5a5be22638df+5:5520:x1869325080202752:12345-192.168.204.35@tcp:13: Request processed in 953us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727459.411506:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 9 00010000:00010000:2.0:1782727459.877566:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727460.904875:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727461.030042:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100146560:0@lo:13: 00000100:00100000:1.0:1782727461.030125:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727461.033711:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100146560 00000100:00100000:2.0:1782727461.033739:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100146560 00000100:00100000:2.0:1782727461.033836:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782727461.033847:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100146560:12345-0@lo:13: 00002000:00000024:2.0:1782727461.033882:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727461.033971:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100146560:12345-0@lo:13: Request processed in 126us (3846us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727461.033978:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1782727461.034002:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727461.034043:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b0eca80 x1869325100146560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727461.034067:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100146560:0@lo:13: 00000001:00100000:0.0:1782727461.544393:0:5931:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f875d55c-258d-46bd-8e2e-5a5be22638df 00000001:02000400:0.0:1782727461.846071:0:8672:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1782727461.926326:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727462.196301:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727462.196349:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727462.196438:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727462.196470:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727462.196507:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080203136 00000100:00100000:0.0:1782727462.196518:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080203136 00000100:00100000:0.0:1782727462.196580:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080203264 00000100:00100000:0.0:1782727462.196584:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080203264 00000100:00100000:0.0:1782727462.196603:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:0.0:1782727462.196612:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3daf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2352:x1869325080203136:12345-192.168.204.35@tcp:400: 00000100:00100000:0.0:1782727462.196695:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3daf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2352:x1869325080203136:12345-192.168.204.35@tcp:400: Request processed in 83us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727462.196730:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:0.0:1782727462.196751:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:0.0:1782727462.196757:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3daf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2352:x1869325080203264:12345-192.168.204.35@tcp:400: 00000100:00100000:0.0:1782727462.196784:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3daf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2352:x1869325080203264:12345-192.168.204.35@tcp:400: Request processed in 28us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727462.196791:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:2.0:1782727462.197222:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080203008 00000100:00100000:2.0:1782727462.197227:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080203008 00000100:00100000:2.0:1782727462.197272:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00100000:2.0:1782727462.197289:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dafaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2352:x1869325080203008:12345-192.168.204.35@tcp:400: 00000100:00100000:2.0:1782727462.197325:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dafaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2352:x1869325080203008:12345-192.168.204.35@tcp:400: Request processed in 38us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727462.197331:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00080000:2.0:1782727462.197350:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782727462.197355:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782727462.197357:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727462.199068:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080202880 00000100:00100000:1.0:1782727462.199081:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080202880 00000100:00100000:1.0:1782727462.199156:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 128 00000100:00100000:1.0:1782727462.199166:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2352:x1869325080202880:12345-192.168.204.35@tcp:400: 00000100:00100000:1.0:1782727462.199230:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2352:x1869325080202880:12345-192.168.204.35@tcp:400: Request processed in 66us (2941us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727462.199237:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 128 00000100:00100000:3.0:1782727462.567366:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100146688:0@lo:400: 00000100:00100000:3.0:1782727462.567483:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727462.567559:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325100147200:0@lo:400: 00000100:00100000:3.0:1782727462.567854:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727462.567885:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782727462.567891:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325100146816:0@lo:400: 00000100:00100000:3.0:1782727462.567914:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727462.567932:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100147328:0@lo:400: 00000100:00100000:3.0:1782727462.567975:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727462.568007:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325100146944:0@lo:400: 00000100:00100000:3.0:1782727462.568030:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727462.568047:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727462.568052:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100147072:0@lo:400: 00000100:00100000:3.0:1782727462.568078:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727462.568115:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100146688 00000100:00100000:3.0:1782727462.568125:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100146688 00000100:00100000:3.0:1782727462.568408:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1782727462.568422:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f581c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3445:x1869325100146688:12345-0@lo:400: 00000100:00100000:3.0:1782727462.568490:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f581c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3445:x1869325100146688:12345-0@lo:400: Request processed in 70us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727462.568498:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1782727462.568540:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100147200 00000100:00100000:3.0:1782727462.568544:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100147200 00000100:00100000:0.0:1782727462.568735:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100147328 00000100:00100000:0.0:1782727462.568740:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100147328 00000100:00100000:0.0:1782727462.568776:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100147072 00000100:00100000:0.0:1782727462.568779:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100147072 00000100:00100000:0.0:1782727462.568862:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782727462.568869:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100147328:12345-0@lo:400: 00000100:00100000:0.0:1782727462.568914:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100147328:12345-0@lo:400: Request processed in 44us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727462.568921:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782727462.568938:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782727462.568944:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100147072:12345-0@lo:400: 00000100:00100000:0.0:1782727462.568977:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100147072:12345-0@lo:400: Request processed in 33us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727462.568983:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782727462.569001:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100146816 00000100:00100000:0.0:1782727462.569005:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100146816 00000100:00100000:0.0:1782727462.569022:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100146944 00000100:00100000:0.0:1782727462.569025:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100146944 00000100:00100000:0.0:1782727462.569039:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782727462.569046:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325100146816:12345-0@lo:400: 00000100:00100000:0.0:1782727462.569107:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325100146816:12345-0@lo:400: Request processed in 61us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727462.569114:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782727462.569127:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782727462.569133:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325100146944:12345-0@lo:400: 00000100:00100000:0.0:1782727462.569162:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325100146944:12345-0@lo:400: Request processed in 30us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727462.569168:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1782727462.569329:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782727462.569335:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727462.569391:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325100146816:0@lo:400: 00010000:00080000:2.0:1782727462.569410:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae035be680 x1869325100147328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727462.569422:0:3445:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1782727462.569440:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100147328:0@lo:400: 00000100:00100000:2.0:1782727462.569450:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100146688:0@lo:400: 00000100:00100000:2.0:1782727462.569473:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782727462.569485:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100147456:0@lo:13: 00000100:00100000:2.0:1782727462.569524:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727462.569580:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100147456 00000100:00100000:2.0:1782727462.569584:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100147456 00000100:00100000:2.0:1782727462.569617:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782727462.569624:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100147456:12345-0@lo:13: 00002000:00000024:2.0:1782727462.569651:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727462.569747:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782727462.569756:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325100147200:12345-0@lo:400: 00000100:00100000:3.0:1782727462.569793:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325100147200:12345-0@lo:400: Request processed in 40us (1940us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727462.569800:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782727462.569832:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325100147200:0@lo:400: 00000100:00100000:2.0:1782727462.569904:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100147456:12345-0@lo:13: Request processed in 279us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727462.569911:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1782727462.569952:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b0eca80 x1869325100147456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727462.569968:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100147456:0@lo:13: 00010000:00080000:0.0:1782727462.571083:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae035bf800 x1869325100147072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727462.571101:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100147072:0@lo:400: 00000100:00100000:0.0:1782727462.571118:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325100146944:0@lo:400: 00000001:00100000:1.0:1782727462.578609:0:6933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f875d55c-258d-46bd-8e2e-5a5be22638df 00010000:00010000:2.0:1782727462.950841:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727463.974517:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727464.998583:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782727465.480150:0:8820:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0246e490 20000000:00000080:0.0:1782727465.480168:0:8820:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90ae2e476400 uarg=0000000000000000 20000000:01000000:0.0:1782727465.480226:0:8820:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1782727465.480228:0:8820:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1782727465.480231:0:8820:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1782727465.480236:0:8820:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1782727465.480241:0:8820:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1782727465.480313:0:8820:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782727465.480316:0:8820:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1782727465.484003:0:8821:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1782727465.484223:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1782727465.484254:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1782727465.484270:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1782727465.484280:0:8820:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1782727465.484297:0:8820:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1782727465.485023:0:8822:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1782727465.489600:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1782727465.489655:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1782727465.489673:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1782727465.489689:0:8820:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1782727465.489691:0:8820:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782727465.490987:0:8823:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1782727465.491511:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1782727465.491541:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1782727465.491557:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1782727465.491568:0:8820:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1782727465.491571:0:8820:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1782727465.502778:0:8824:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1782727465.503081:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1782727465.503111:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1782727465.503126:0:8820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:0.0:1782727465.503141:0:8820:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782727465.503162:0:8820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504973 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.503181:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504869 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.503190:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae013a0800/0x8db73d43f550489a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504893 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.503197:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae00030a00/0x8db73d43f55048c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55048bd expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.503204:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae00030c00/0x8db73d43f55048d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55048cb expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.503210:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae0a3c7c00/0x8db73d43f55048e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55048d9 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.503217:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae37da7400/0x8db73d43f55048fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55048f5 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.503225:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae00031600/0x8db73d43f5504926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f550491f expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.503246:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae01538a00/0x8db73d43f5504934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357763 expref: 9 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.503255:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae0a3c7600/0x8db73d43f550493b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735776a expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.503262:0:8820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504973 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.503304:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae0a3c7600/0x8db73d43f550493b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x9cd528c39735776a expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.503318:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90ae0a3c7600/0x8db73d43f550493b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c39735776a expref: 9 pid: 5944 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727465.503334:0:8820:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3daf8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325100147584:192.168.204.35@tcp:104: 00010000:00010000:0.0:1782727465.503476:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae01538a00/0x8db73d43f5504934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x9cd528c397357763 expref: 9 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.503485:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90ae01538a00/0x8db73d43f5504934 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c397357763 expref: 9 pid: 5947 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727465.503493:0:8820:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dafb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325100147712:192.168.204.35@tcp:104: 00010000:00010000:0.0:1782727465.503525:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae00031600/0x8db73d43f5504926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f550491f expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.503534:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae00031600/0x8db73d43f5504926 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f550491f expref: 18 pid: 5946 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727465.503556:0:8820:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3daf8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325100147840:0@lo:104: 00000100:00100000:0.0:1782727465.503609:0:8820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782727465.503659:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae37da7400/0x8db73d43f55048fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f55048f5 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.503667:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae37da7400/0x8db73d43f55048fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f55048f5 expref: 18 pid: 5946 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727465.503676:0:8820:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325100147968:0@lo:104: 00000100:00100000:0.0:1782727465.503699:0:8820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727465.503734:0:5936:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782727465.503746:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100147840 00000100:00100000:0.0:1782727465.503752:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100147840 00000100:00100000:0.0:1782727465.503783:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100147968 00000100:00100000:0.0:1782727465.503786:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100147968 00000100:00100000:0.0:1782727465.503800:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782727465.503808:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+4:8820:x1869325100147840:12345-0@lo:104: 00010000:00010000:0.0:1782727465.503820:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae01539a00/0x8db73d43f550491f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f5504926 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.503862:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782727465.503869:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+4:8820:x1869325100147840:12345-0@lo:104: Request processed in 62us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727465.503876:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782727465.503893:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782727465.503899:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b365450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:8820:x1869325100147968:12345-0@lo:104: 00010000:00010000:0.0:1782727465.503905:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55048f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f55048fc expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.503943:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782727465.503948:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b365450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:8820:x1869325100147968:12345-0@lo:104: Request processed in 50us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727465.503954:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1782727465.503995:0:8017:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782727465.504001:0:8017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae01539a00/0x8db73d43f550491f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f5504926 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504008:0:8017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01539a00 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:0.0:1782727465.504012:0:8017:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae01539a00/0x8db73d43f550491f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f5504926 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504020:0:8017:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae01539a00/0x8db73d43f550491f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f5504926 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727465.504027:0:8017:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae01539a00/0x8db73d43f550491f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f5504926 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727465.504033:0:8017:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727465.504061:0:8017:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae01539a00/0x8db73d43f550491f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504926 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504068:0:8017:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727465.504085:0:8017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae01539a00/0x8db73d43f550491f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504926 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504093:0:8017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae01539a00/0x8db73d43f550491f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504926 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504117:0:8017:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727465.504121:0:8017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55048f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f55048fc expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504127:0:8017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae37da7600 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:0.0:1782727465.504130:0:8017:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55048f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f55048fc expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504136:0:8017:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55048f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f55048fc expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727465.504143:0:8017:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55048f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f55048fc expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727465.504148:0:8017:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727465.504162:0:8017:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55048f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55048fc expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504168:0:8017:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727465.504182:0:8017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55048f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55048fc expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504189:0:8017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55048f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55048fc expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504199:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727465.504201:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727465.504203:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727465.504219:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727465.504239:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100148096:0@lo:103: 00000100:00100000:0.0:1782727465.504267:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727465.504288:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727465.504297:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100148224:0@lo:103: 00000100:00100000:0.0:1782727465.504317:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727465.504339:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100148096 00000100:00100000:0.0:1782727465.504342:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100148096 00010000:00010000:0.0:1782727465.504359:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae00031600/0x8db73d43f5504926 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f550491f expref: 19 pid: 5946 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727465.504406:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100148224 00000100:00100000:0.0:1782727465.504409:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100148224 00010000:00010000:0.0:1782727465.504420:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae37da7400/0x8db73d43f55048fc lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55048f5 expref: 20 pid: 5946 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727465.504432:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782727465.504438:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+20:3443:x1869325100148096:12345-0@lo:103: 00010000:00010000:0.0:1782727465.504449:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727465.504454:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae00031600/0x8db73d43f5504926 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f550491f expref: 20 pid: 5946 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504463:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae00031600/0x8db73d43f5504926 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f550491f expref: 20 pid: 5946 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504477:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727465.504505:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+20:3443:x1869325100148096:12345-0@lo:103: Request processed in 66us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727465.504511:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782727465.504525:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782727465.504531:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3446:x1869325100148224:12345-0@lo:103: 00010000:00010000:0.0:1782727465.504544:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727465.504549:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae37da7400/0x8db73d43f55048fc lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55048f5 expref: 19 pid: 5946 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504557:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae37da7400/0x8db73d43f55048fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f55048f5 expref: 19 pid: 5946 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504567:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727465.504593:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3446:x1869325100148224:12345-0@lo:103: Request processed in 63us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727465.504600:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782727465.504633:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100148096:0@lo:103: 00000100:00100000:0.0:1782727465.504674:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100148224:0@lo:103: 00010000:00010000:0.0:1782727465.504706:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae0a3c7c00/0x8db73d43f55048e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f55048d9 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504715:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae0a3c7c00/0x8db73d43f55048e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f55048d9 expref: 18 pid: 5947 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727465.504723:0:8820:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0f7d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325100148352:0@lo:104: 00000100:00100000:0.0:1782727465.504744:0:8820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727465.504763:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100148352 00000100:00100000:0.0:1782727465.504766:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100148352 00000100:00100000:0.0:1782727465.504783:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782727465.504788:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:8820:x1869325100148352:12345-0@lo:104: 00010000:00010000:0.0:1782727465.504796:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae013a0600/0x8db73d43f55048d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f55048e0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504837:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782727465.504843:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:8820:x1869325100148352:12345-0@lo:104: Request processed in 55us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727465.504849:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1782727465.504864:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727465.504868:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae013a0600/0x8db73d43f55048d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f55048e0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504874:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae013a0600 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:0.0:1782727465.504878:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae013a0600/0x8db73d43f55048d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f55048e0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504884:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae013a0600/0x8db73d43f55048d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f55048e0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727465.504890:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae013a0600/0x8db73d43f55048d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f55048e0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727465.504895:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727465.504925:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae013a0600/0x8db73d43f55048d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55048e0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504931:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727465.504941:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae013a0600/0x8db73d43f55048d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55048e0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504947:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae013a0600/0x8db73d43f55048d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55048e0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.504969:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727465.504970:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727465.504972:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727465.504985:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100148480:0@lo:103: 00000100:00100000:0.0:1782727465.505008:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727465.505031:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100148480 00000100:00100000:0.0:1782727465.505034:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100148480 00010000:00010000:0.0:1782727465.505046:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae0a3c7c00/0x8db73d43f55048e0 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55048d9 expref: 19 pid: 5947 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727465.505058:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782727465.505064:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e007800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3446:x1869325100148480:12345-0@lo:103: 00010000:00010000:0.0:1782727465.505070:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727465.505074:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae0a3c7c00/0x8db73d43f55048e0 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55048d9 expref: 19 pid: 5947 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.505081:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae0a3c7c00/0x8db73d43f55048e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f55048d9 expref: 19 pid: 5947 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.505090:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727465.505113:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e007800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3446:x1869325100148480:12345-0@lo:103: Request processed in 49us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727465.505119:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782727465.505140:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100148480:0@lo:103: 00010000:00010000:0.0:1782727465.505162:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae00030c00/0x8db73d43f55048d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f55048cb expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.505182:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae00030c00/0x8db73d43f55048d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f55048cb expref: 18 pid: 5944 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727465.505191:0:8820:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e005180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325100148608:0@lo:104: 00000100:00100000:0.0:1782727465.505212:0:8820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727465.505228:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100148608 00000100:00100000:0.0:1782727465.505231:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100148608 00000100:00100000:0.0:1782727465.505246:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782727465.505251:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e006300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:8820:x1869325100148608:12345-0@lo:104: 00010000:00010000:0.0:1782727465.505258:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae013a1c00/0x8db73d43f55048cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f55048d2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.505285:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782727465.505290:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e006300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:8820:x1869325100148608:12345-0@lo:104: Request processed in 40us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727465.505296:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1782727465.505310:0:8017:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727465.505314:0:8017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae013a1c00/0x8db73d43f55048cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f55048d2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.505320:0:8017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae013a1c00 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:0.0:1782727465.505323:0:8017:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae013a1c00/0x8db73d43f55048cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f55048d2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.505329:0:8017:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae013a1c00/0x8db73d43f55048cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f55048d2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727465.505336:0:8017:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae013a1c00/0x8db73d43f55048cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f55048d2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727465.505348:0:8017:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727465.505366:0:8017:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae013a1c00/0x8db73d43f55048cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55048d2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.505397:0:8017:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727465.505408:0:8017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae013a1c00/0x8db73d43f55048cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55048d2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.505415:0:8017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae013a1c00/0x8db73d43f55048cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55048d2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.505426:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727465.505427:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727465.505429:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727465.505442:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100148736:0@lo:103: 00000100:00100000:0.0:1782727465.505466:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727465.505493:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100148736 00000100:00100000:0.0:1782727465.505496:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100148736 00010000:00010000:0.0:1782727465.505508:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae00030c00/0x8db73d43f55048d2 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55048cb expref: 19 pid: 5944 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727465.505521:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782727465.505527:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e005c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100148736:12345-0@lo:103: 00010000:00010000:0.0:1782727465.505533:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727465.505537:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae00030c00/0x8db73d43f55048d2 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55048cb expref: 19 pid: 5944 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.505543:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae00030c00/0x8db73d43f55048d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f55048cb expref: 19 pid: 5944 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.505557:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727465.505581:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e005c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100148736:12345-0@lo:103: Request processed in 55us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727465.505587:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782727465.505608:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100148736:0@lo:103: 00010000:00010000:0.0:1782727465.505633:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae00030a00/0x8db73d43f55048c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f55048bd expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.505655:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae00030a00/0x8db73d43f55048c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f55048bd expref: 18 pid: 5944 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727465.505662:0:8820:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e007480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325100148864:0@lo:104: 00000100:00100000:0.0:1782727465.505684:0:8820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727465.505700:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100148864 00000100:00100000:0.0:1782727465.505704:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100148864 00000100:00100000:0.0:1782727465.505720:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782727465.505725:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e005880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:8820:x1869325100148864:12345-0@lo:104: 00010000:00010000:0.0:1782727465.505732:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae00031800/0x8db73d43f55048bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f55048c4 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.505758:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782727465.505763:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e005880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:8820:x1869325100148864:12345-0@lo:104: Request processed in 38us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727465.505768:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1782727465.505779:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727465.505783:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae00031800/0x8db73d43f55048bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f55048c4 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.505798:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae00031800 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:0.0:1782727465.505801:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae00031800/0x8db73d43f55048bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f55048c4 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.505808:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae00031800/0x8db73d43f55048bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f55048c4 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727465.505813:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae00031800/0x8db73d43f55048bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f55048c4 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727465.505818:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727465.505835:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae00031800/0x8db73d43f55048bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55048c4 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.505841:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727465.505849:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae00031800/0x8db73d43f55048bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55048c4 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.505855:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae00031800/0x8db73d43f55048bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55048c4 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.505866:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727465.505867:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727465.505869:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727465.505879:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727465.505886:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100148992:0@lo:103: 00000100:00100000:0.0:1782727465.505908:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727465.505927:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100148992 00000100:00100000:0.0:1782727465.505930:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100148992 00010000:00010000:0.0:1782727465.505948:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae00030a00/0x8db73d43f55048c4 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55048bd expref: 19 pid: 5944 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727465.505962:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782727465.505967:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e004380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100148992:12345-0@lo:103: 00010000:00010000:0.0:1782727465.505974:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727465.505977:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae00030a00/0x8db73d43f55048c4 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55048bd expref: 19 pid: 5944 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.505985:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae00030a00/0x8db73d43f55048c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f55048bd expref: 19 pid: 5944 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727465.505995:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727465.506020:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e004380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100148992:12345-0@lo:103: Request processed in 52us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727465.506027:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1782727465.506310:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727465.507721:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae013a0800/0x8db73d43f550489a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f5504893 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727465.507740:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae013a0800/0x8db73d43f550489a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f5504893 expref: 18 pid: 5947 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727465.507755:0:8820:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f53800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325100149120:0@lo:104: 00000100:00100000:1.0:1782727465.507814:0:8820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727465.509722:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727465.509757:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727465.509790:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080203392 00000100:00100000:3.0:1782727465.509798:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080203392 00010000:00010000:1.0:1782727465.510187:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f5504869 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727465.510204:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504870 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f5504869 expref: 18 pid: 5947 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727465.510219:0:8820:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f50a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325100149248:0@lo:104: 00000100:00100000:1.0:1782727465.510264:0:8820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727465.511036:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100148992:0@lo:103: 00010000:00010000:3.0:1782727465.511209:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae0a3c7600/0x8db73d43f550493b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c39735776a expref: 10 pid: 5944 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727465.511256:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080203520 00000100:00100000:3.0:1782727465.511263:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080203520 00010000:00010000:3.0:1782727465.511275:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae01538a00/0x8db73d43f5504934 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c397357763 expref: 11 pid: 5947 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727465.511299:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:3.0:1782727465.511307:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+11:2350:x1869325080203392:12345-192.168.204.35@tcp:103: 00010000:00010000:3.0:1782727465.511322:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727465.511327:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae0a3c7600/0x8db73d43f550493b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c39735776a expref: 11 pid: 5944 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727465.511337:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae0a3c7600/0x8db73d43f550493b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c39735776a expref: 11 pid: 5944 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727465.511355:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727465.511434:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+11:2350:x1869325080203392:12345-192.168.204.35@tcp:103: Request processed in 126us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727465.511442:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:3.0:1782727465.511461:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00100000:3.0:1782727465.511468:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3416d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2350:x1869325080203520:12345-192.168.204.35@tcp:103: 00010000:00010000:3.0:1782727465.511475:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727465.511479:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae01538a00/0x8db73d43f5504934 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c397357763 expref: 10 pid: 5947 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727465.511489:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae01538a00/0x8db73d43f5504934 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c397357763 expref: 10 pid: 5947 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727465.511511:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727465.511530:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3416d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2350:x1869325080203520:12345-192.168.204.35@tcp:103: Request processed in 63us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727465.511537:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00100000:1.0:1782727465.517362:0:8820:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b3170c0 going to sleep for 11 seconds 00010000:00010000:1.0:1782727465.517592:0:8820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae0a3c7600/0x8db73d43f550493b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c39735776a expref: 9 pid: 5944 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727465.517611:0:8820:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3daf8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325100147584:192.168.204.35@tcp:104: 00010000:00010000:1.0:1782727465.517623:0:8820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae01538a00/0x8db73d43f5504934 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c397357763 expref: 8 pid: 5947 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727465.517842:0:8820:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dafb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325100147712:192.168.204.35@tcp:104: 00010000:00010000:1.0:1782727465.517861:0:8820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae00031600/0x8db73d43f5504926 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f550491f expref: 18 pid: 5946 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727465.517930:0:8820:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3daf8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325100147840:0@lo:104: 00010000:00010000:1.0:1782727465.517967:0:8820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae37da7400/0x8db73d43f55048fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f55048f5 expref: 17 pid: 5946 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727465.517978:0:8820:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325100147968:0@lo:104: 00010000:00010000:1.0:1782727465.517988:0:8820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae0a3c7c00/0x8db73d43f55048e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f55048d9 expref: 16 pid: 5947 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727465.517996:0:8820:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0f7d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325100148352:0@lo:104: 00010000:00010000:1.0:1782727465.518005:0:8820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae00030c00/0x8db73d43f55048d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f55048cb expref: 15 pid: 5944 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727465.518014:0:8820:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e005180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325100148608:0@lo:104: 00010000:00010000:1.0:1782727465.518412:0:8820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae00030a00/0x8db73d43f55048c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f55048bd expref: 14 pid: 5944 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727465.518423:0:8820:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e007480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325100148864:0@lo:104: 00000100:00100000:2.0:1782727465.519524:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100149120 00000100:00100000:2.0:1782727465.519534:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100149120 00000100:00100000:2.0:1782727465.519583:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100149248 00000100:00100000:2.0:1782727465.519586:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100149248 00000100:00100000:2.0:1782727465.519600:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782727465.519608:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+4:8820:x1869325100149120:12345-0@lo:104: 00010000:00010000:2.0:1782727465.519625:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f550489a expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.519737:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782727465.519743:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+4:8820:x1869325100149120:12345-0@lo:104: Request processed in 136us (11930us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727465.519750:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782727465.519765:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782727465.519771:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:8820:x1869325100149248:12345-0@lo:104: 00010000:00010000:2.0:1782727465.519778:0:5936:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae01538400/0x8db73d43f5504869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f5504870 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.519812:0:5936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782727465.519816:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:8820:x1869325100149248:12345-0@lo:104: Request processed in 46us (9552us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727465.519822:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1782727465.519861:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782727465.519867:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f550489a expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.519874:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae0a3c6e00 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:2.0:1782727465.519879:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f550489a expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.519888:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f550489a expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727465.519895:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f550489a expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727465.519900:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782727465.519933:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504893 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f550489a expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.519939:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782727465.519955:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504893 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f550489a expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.519962:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504893 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f550489a expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.519974:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727465.519977:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae01538400/0x8db73d43f5504869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f5504870 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.519983:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01538400 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:2.0:1782727465.519986:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae01538400/0x8db73d43f5504869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f5504870 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.519998:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae01538400/0x8db73d43f5504869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f5504870 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727465.520004:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae01538400/0x8db73d43f5504869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f5504870 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727465.520009:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782727465.520019:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae01538400/0x8db73d43f5504869 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504870 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.520023:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782727465.520028:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae01538400/0x8db73d43f5504869 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504870 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.520034:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae01538400/0x8db73d43f5504869 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504870 expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.520058:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727465.520060:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727465.520061:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727465.520080:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100149504:0@lo:103: 00000100:00100000:2.0:1782727465.520114:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727465.520145:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727465.520149:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100149376:0@lo:103: 00000100:00100000:2.0:1782727465.520165:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727465.520184:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100149504 00000100:00100000:2.0:1782727465.520188:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100149504 00010000:00010000:2.0:1782727465.520202:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504870 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f5504869 expref: 14 pid: 5947 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727465.520229:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100149376 00000100:00100000:2.0:1782727465.520231:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100149376 00010000:00010000:2.0:1782727465.520240:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae013a0800/0x8db73d43f550489a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f5504893 expref: 15 pid: 5947 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727465.520249:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782727465.520254:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:3446:x1869325100149504:12345-0@lo:103: 00010000:00010000:2.0:1782727465.520263:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727465.520267:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504870 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f5504869 expref: 15 pid: 5947 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.520276:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504870 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f5504869 expref: 15 pid: 5947 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.520291:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727465.520316:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:3446:x1869325100149504:12345-0@lo:103: Request processed in 60us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727465.520322:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782727465.520333:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782727465.520338:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:3446:x1869325100149376:12345-0@lo:103: 00010000:00010000:2.0:1782727465.520345:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727465.520349:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae013a0800/0x8db73d43f550489a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f5504893 expref: 14 pid: 5947 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.520358:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae013a0800/0x8db73d43f550489a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f5504893 expref: 14 pid: 5947 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.520415:0:5937:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504973 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.520432:0:5937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504973 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.520447:0:5937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504973 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.520455:0:5937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504973 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.520461:0:5937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504973 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.520468:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504973 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.520474:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae00030e00 already unused, calling callback (ffffffffc0b2bcf0) 00010000:00010000:2.0:1782727465.520479:0:5937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504973 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.520486:0:5937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504973 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.520493:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504973 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727465.520502:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727465.520525:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:3446:x1869325100149376:12345-0@lo:103: Request processed in 186us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727465.520531:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782727465.520560:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100149376:0@lo:103: 00000100:00100000:2.0:1782727465.520577:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100149504:0@lo:103: 00010000:00010000:3.0:1782727465.520709:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727465.521515:0:8820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae013a0800/0x8db73d43f550489a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f5504893 expref: 13 pid: 5947 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727465.521532:0:8820:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f53800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325100149120:0@lo:104: 00010000:00010000:1.0:1782727465.521543:0:8820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae013a0200/0x8db73d43f5504870 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f5504869 expref: 12 pid: 5947 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727465.521552:0:8820:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f50a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8820:1869325100149248:0@lo:104: 00010000:00010000:1.0:1782727465.521587:0:8820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504973 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727465.521597:0:8820:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504973 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727465.521615:0:8820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504973 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727465.521620:0:8820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504973 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727466.021898:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727466.149755:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100149632:0@lo:13: 00000100:00100000:1.0:1782727466.149836:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727466.149969:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100149632 00000100:00100000:2.0:1782727466.149979:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100149632 00000100:00100000:2.0:1782727466.150053:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782727466.150063:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100149632:12345-0@lo:13: 00002000:00000024:2.0:1782727466.150089:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727466.150132:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100149632:12345-0@lo:13: Request processed in 71us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727466.150138:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1782727466.150207:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782727466.150236:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b0ee300 x1869325100149632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727466.150253:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100149632:0@lo:13: 00000100:00100000:0.0:1782727466.802290:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727466.802405:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080203648 00000100:00100000:2.0:1782727466.802416:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080203648 00000100:00100000:2.0:1782727466.802479:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 130 00000100:00100000:2.0:1782727466.802490:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+8:5441:x1869325080203648:12345-192.168.204.35@tcp:101: 00010000:00010000:2.0:1782727466.802506:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727466.802525:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae0a3c7c00/0x8db73d43f550497a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cd528c3973577cc expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727466.802553:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae0a3c7c00/0x8db73d43f550497a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577cc expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727466.802563:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae0a3c7c00/0x8db73d43f550497a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577cc expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727466.802571:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae0a3c7c00, rc 0) 00000100:00100000:2.0:1782727466.802645:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+9:5441:x1869325080203648:12345-192.168.204.35@tcp:101: Request processed in 157us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727466.802668:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 130 00000100:00100000:3.0:1782727466.808253:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727466.809177:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080203776 00000100:00100000:2.0:1782727466.809188:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080203776 00000100:00100000:2.0:1782727466.809269:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 131 00000100:00100000:2.0:1782727466.809279:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+9:5441:x1869325080203776:12345-192.168.204.35@tcp:501: 00000100:00100000:2.0:1782727466.809519:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+9:5441:x1869325080203776:12345-192.168.204.35@tcp:501: Request processed in 241us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727466.809527:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 131 00000100:00100000:0.0:1782727466.819122:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727466.822063:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080203904 00000100:00100000:3.0:1782727466.822077:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080203904 00000100:00100000:3.0:1782727466.822157:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 132 00000100:00100000:3.0:1782727466.822168:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+9:5441:x1869325080203904:12345-192.168.204.35@tcp:503: 00000100:00100000:3.0:1782727466.823242:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+9:5441:x1869325080203904:12345-192.168.204.35@tcp:503: Request processed in 1069us (4123us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727466.823254:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 132 00000100:00100000:0.0:1782727466.828359:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727466.829026:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080204032 00000100:00100000:1.0:1782727466.829037:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080204032 00000100:00100000:1.0:1782727466.829099:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 133 00000100:00100000:1.0:1782727466.829109:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+9:5914:x1869325080204032:12345-192.168.204.35@tcp:502: 00000100:00100000:1.0:1782727466.829462:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+9:5914:x1869325080204032:12345-192.168.204.35@tcp:502: Request processed in 353us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727466.829471:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 133 00000100:00100000:1.0:1782727466.834513:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727466.834626:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080204160 00000100:00100000:3.0:1782727466.834636:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080204160 00000100:00100000:3.0:1782727466.834698:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 134 00000100:00100000:3.0:1782727466.834708:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+9:5914:x1869325080204160:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782727466.835299:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+9:5914:x1869325080204160:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 590us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727466.835308:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 134 00000100:00100000:0.0:1782727466.840968:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727466.841255:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080204288 00000100:00100000:1.0:1782727466.841265:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080204288 00000100:00100000:1.0:1782727466.841328:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 135 00000100:00100000:1.0:1782727466.841339:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+9:5441:x1869325080204288:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727466.841358:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727466.841427:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae37da6600/0x8db73d43f5504981 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cd528c3973577d3 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727466.841457:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae37da6600/0x8db73d43f5504981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577d3 expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727466.841467:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae37da6600/0x8db73d43f5504981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577d3 expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727466.841475:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae37da6600, rc 0) 00000100:00100000:1.0:1782727466.841555:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5441:x1869325080204288:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 217us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727466.841562:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 135 00000100:00100000:0.0:1782727466.846669:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727466.847115:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080204416 00000100:00100000:3.0:1782727466.847125:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080204416 00000100:00100000:3.0:1782727466.847189:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 136 00000100:00100000:3.0:1782727466.847199:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5441:x1869325080204416:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727466.847331:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5441:x1869325080204416:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 133us (673us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782727466.847355:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 136 00010000:00010000:2.0:1782727467.045783:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782727467.109517:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782727467.109525:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff90ae3dae6000 from 39 10000000:01000000:2.0:1782727467.109538:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782727467.109590:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7600/0x8db73d43f5504988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727467.109616:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7600/0x8db73d43f5504988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727467.109628:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7600/0x8db73d43f5504988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727467.109655:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100149760:0@lo:101: 00000100:00100000:2.0:1782727467.109748:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727467.109927:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100149760 00000100:00100000:1.0:1782727467.109935:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100149760 00000100:00100000:1.0:1782727467.110003:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1782727467.110014:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+12:5949:x1869325100149760:12345-0@lo:101: 00010000:00010000:1.0:1782727467.110028:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727467.110042:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae37da7a00/0x8db73d43f550498f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f5504988 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727467.110071:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae37da7a00/0x8db73d43f550498f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f5504988 expref: 13 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727467.110082:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae37da7a00/0x8db73d43f550498f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504988 expref: 13 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727467.110092:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae37da7a00, rc 0) 00000100:00100000:1.0:1782727467.110131:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:5949:x1869325100149760:12345-0@lo:101: Request processed in 119us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727467.110156:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1782727467.110421:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b0e6480 going to sleep for 11 seconds 00000100:00100000:2.0:1782727467.110448:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100149760:0@lo:101: 00010000:00010000:2.0:1782727467.110464:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7600/0x8db73d43f5504988 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550498f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727467.110484:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7600/0x8db73d43f5504988 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f550498f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727467.110547:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100149888:0@lo:501: 00000100:00100000:2.0:1782727467.110575:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727467.110640:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100149888 00000100:00100000:1.0:1782727467.110644:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100149888 00000100:00100000:1.0:1782727467.110671:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1782727467.110677:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:5949:x1869325100149888:12345-0@lo:501: 00000100:00100000:1.0:1782727467.110786:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:5949:x1869325100149888:12345-0@lo:501: Request processed in 109us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727467.110793:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1782727467.114583:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b0e6480 going to sleep for 11 seconds 00000100:00100000:2.0:1782727467.114647:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100149888:0@lo:501: 00000100:00100000:2.0:1782727467.114713:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100150016:0@lo:503: 00000100:00100000:2.0:1782727467.114805:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727467.114923:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b0e6480 going to sleep for 11 seconds 00000100:00100000:1.0:1782727467.114982:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100150016 00000100:00100000:1.0:1782727467.115065:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100150016 00000100:00100000:1.0:1782727467.115178:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1782727467.115187:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:5949:x1869325100150016:12345-0@lo:503: 00000100:00100000:1.0:1782727467.115315:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:5949:x1869325100150016:12345-0@lo:503: Request processed in 128us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727467.115322:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1782727467.115420:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100150016:0@lo:503: 00000100:00100000:0.0:1782727467.116021:0:8836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e006a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8836:1869325100150144:0@lo:502: 00000100:00100000:0.0:1782727467.116067:0:8836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727467.116693:0:8836:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b317d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782727467.116788:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100150144 00000100:00100000:2.0:1782727467.116796:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100150144 00000100:00100000:2.0:1782727467.116833:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1782727467.116840:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:8836:x1869325100150144:12345-0@lo:502: 00000100:00100000:2.0:1782727467.116958:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:8836:x1869325100150144:12345-0@lo:502: Request processed in 117us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727467.116966:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1782727467.117089:0:8836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e006a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8836:1869325100150144:0@lo:502: 00000100:00100000:0.0:1782727467.117158:0:8836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e006a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8836:1869325100150272:0@lo:502: 00000100:00100000:0.0:1782727467.117195:0:8836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727467.117210:0:8836:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b317d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782727467.117810:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100150272 00000100:00100000:2.0:1782727467.117816:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100150272 00000100:00100000:2.0:1782727467.117837:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1782727467.117843:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:8836:x1869325100150272:12345-0@lo:502: 00000100:00100000:2.0:1782727467.117921:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:8836:x1869325100150272:12345-0@lo:502: Request processed in 77us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727467.117928:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1782727467.118085:0:8836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e006a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8836:1869325100150272:0@lo:502: 00000040:00080000:0.0:1782727467.118108:0:8836:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1782727467.118741:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1782727467.118773:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782727467.118782:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7600/0x8db73d43f5504988 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550498f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727467.118792:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7600/0x8db73d43f5504988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550498f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727467.118801:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1782727467.118804:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1782727467.118806:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1782727467.118832:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727467.118840:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727467.118848:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727467.118865:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100150400:0@lo:101: 00000100:00100000:2.0:1782727467.118902:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727467.118939:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b0e6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727467.119076:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100150400 00000100:00100000:1.0:1782727467.119082:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100150400 00000100:00100000:1.0:1782727467.119114:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1782727467.119122:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+13:5949:x1869325100150400:12345-0@lo:101: 00010000:00010000:1.0:1782727467.119134:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727467.119233:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae37da6400/0x8db73d43f550499d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f5504996 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727467.119260:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae37da6400/0x8db73d43f550499d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f5504996 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727467.119270:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae37da6400/0x8db73d43f550499d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504996 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727467.119286:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae37da6400, rc 0) 00000100:00100000:1.0:1782727467.119334:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:5949:x1869325100150400:12345-0@lo:101: Request processed in 212us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727467.119340:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1782727467.119440:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100150400:0@lo:101: 00010000:00010000:2.0:1782727467.119454:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504996 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550499d expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727467.119464:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504996 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f550499d expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727467.119511:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100150528:0@lo:501: 00000100:00100000:2.0:1782727467.119541:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727467.119568:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b0e6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727467.119631:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100150528 00000100:00100000:1.0:1782727467.119636:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100150528 00000100:00100000:1.0:1782727467.119655:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1782727467.119661:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:5949:x1869325100150528:12345-0@lo:501: 00000100:00100000:1.0:1782727467.119772:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:5949:x1869325100150528:12345-0@lo:501: Request processed in 111us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727467.119779:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1782727467.119913:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100150528:0@lo:501: 00000100:00100000:2.0:1782727467.119937:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100150656:0@lo:503: 00000100:00100000:2.0:1782727467.119974:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727467.120074:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b0e6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782727467.120116:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100150656 00000100:00100000:0.0:1782727467.120120:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100150656 00000100:00100000:0.0:1782727467.120266:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1782727467.120274:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:5949:x1869325100150656:12345-0@lo:503: 00000100:00100000:0.0:1782727467.120351:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:5949:x1869325100150656:12345-0@lo:503: Request processed in 77us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727467.120358:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782727467.120510:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100150656:0@lo:503: 00000100:00100000:0.0:1782727467.121083:0:8837:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e006a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8837:1869325100150784:0@lo:502: 00000100:00100000:0.0:1782727467.121124:0:8837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727467.121440:0:8837:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b317b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782727467.121491:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100150784 00000100:00100000:1.0:1782727467.121497:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100150784 00000100:00100000:1.0:1782727467.121569:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1782727467.121577:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:8837:x1869325100150784:12345-0@lo:502: 00000100:00100000:1.0:1782727467.121692:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:8837:x1869325100150784:12345-0@lo:502: Request processed in 115us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727467.121699:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1782727467.121764:0:8837:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e006a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8837:1869325100150784:0@lo:502: 00000020:01000000:0.0:1782727467.121787:0:8837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727467.121797:0:8837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727467.121799:0:8837:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782727467.121803:0:8837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782727467.121823:0:8837:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e006a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8837:1869325100150912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727467.121856:0:8837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727467.121917:0:8837:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b317b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727467.121985:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100150912 00000100:00100000:2.0:1782727467.122064:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100150912 00000100:00100000:2.0:1782727467.122089:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1782727467.122096:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:8837:x1869325100150912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727467.122296:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:8837:x1869325100150912:12345-0@lo:502:llog_process_th.0 Request processed in 199us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727467.122304:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1782727467.122403:0:8837:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e006a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8837:1869325100150912:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782727467.122421:0:8837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727467.122431:0:8837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727467.122433:0:8837:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782727467.122437:0:8837:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1782727467.122651:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1782727467.122670:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1782727467.122680:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504996 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550499d expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727467.122692:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6e00/0x8db73d43f5504996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f550499d expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727467.122702:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782727467.122705:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff90ae06bcd800 from 39 10000000:01000000:2.0:1782727467.122708:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782727467.122732:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6600/0x8db73d43f55049a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727467.122752:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6600/0x8db73d43f55049a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727467.122762:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6600/0x8db73d43f55049a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727467.122777:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100151040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782727467.122810:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727467.122842:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b0e6180 going to sleep for 11 seconds 00000100:00100000:0.0:1782727467.122890:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100151040 00000100:00100000:0.0:1782727467.122895:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100151040 00000100:00100000:0.0:1782727467.122924:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1782727467.122931:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+14:5949:x1869325100151040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727467.122940:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727467.122952:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae00030c00/0x8db73d43f55049ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f55049a4 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727467.122974:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae00030c00/0x8db73d43f55049ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f55049a4 expref: 15 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727467.122984:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae00030c00/0x8db73d43f55049ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55049a4 expref: 15 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727467.123073:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae00030c00, rc 0) 00000100:00100000:0.0:1782727467.123110:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:5949:x1869325100151040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727467.123116:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1782727467.123305:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100151040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727467.123317:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6600/0x8db73d43f55049a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55049ab expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727467.123326:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6600/0x8db73d43f55049a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f55049ab expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727467.123407:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100151168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727467.123434:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727467.123449:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b0e6180 going to sleep for 11 seconds 00000100:00100000:0.0:1782727467.123508:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100151168 00000100:00100000:0.0:1782727467.123512:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100151168 00000100:00100000:0.0:1782727467.123543:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1782727467.123550:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:5949:x1869325100151168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727467.123664:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:5949:x1869325100151168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727467.123672:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1782727467.123770:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100151168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727467.123796:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100151296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727467.123836:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727467.123861:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b0e6180 going to sleep for 11 seconds 00000100:00100000:0.0:1782727467.123905:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100151296 00000100:00100000:0.0:1782727467.123915:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100151296 00000100:00100000:0.0:1782727467.123941:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1782727467.123947:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:5949:x1869325100151296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727467.124356:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:5949:x1869325100151296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 407us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727467.124363:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1782727467.124570:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100151296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727467.124958:0:8838:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8838:1869325100151424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727467.125076:0:8838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727467.125358:0:8838:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b0e6540 going to sleep for 11 seconds 00000100:00100000:0.0:1782727467.125578:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100151424 00000100:00100000:0.0:1782727467.125585:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100151424 00000100:00100000:0.0:1782727467.125640:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1782727467.125649:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:8838:x1869325100151424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727467.125764:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:8838:x1869325100151424:12345-0@lo:502:llog_process_th.0 Request processed in 116us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727467.125772:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1782727467.125930:0:8838:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8838:1869325100151424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727467.125973:0:8838:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8838:1869325100151552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727467.126019:0:8838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727467.126049:0:8838:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b0e6540 going to sleep for 11 seconds 00000100:00100000:3.0:1782727467.126172:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100151552 00000100:00100000:3.0:1782727467.126178:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100151552 00000100:00100000:3.0:1782727467.126216:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1782727467.126224:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:8838:x1869325100151552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727467.126294:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:8838:x1869325100151552:12345-0@lo:502:llog_process_th.0 Request processed in 71us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727467.126301:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782727467.126553:0:8838:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8838:1869325100151552:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1782727467.126572:0:8838:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1782727467.126767:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1782727467.126788:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782727467.126799:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6600/0x8db73d43f55049a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55049ab expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727467.126809:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c6600/0x8db73d43f55049a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55049ab expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727467.126818:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1782727467.126820:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1782727467.126823:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782727467.126849:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae01538c00/0x8db73d43f55049b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727467.126856:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae01538c00/0x8db73d43f55049b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727467.126864:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae01538c00/0x8db73d43f55049b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727467.126877:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100151680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782727467.126919:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727467.126950:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0305ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727467.127003:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100151680 00000100:00100000:2.0:1782727467.127007:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100151680 00000100:00100000:2.0:1782727467.127039:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782727467.127046:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+15:5949:x1869325100151680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727467.127054:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727467.127066:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae0a3c7800/0x8db73d43f55049b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f55049b2 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727467.127086:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae0a3c7800/0x8db73d43f55049b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f55049b2 expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727467.127098:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae0a3c7800/0x8db73d43f55049b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55049b2 expref: 16 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727467.127107:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae0a3c7800, rc 0) 00000100:00100000:2.0:1782727467.127137:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:5949:x1869325100151680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727467.127156:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1782727467.127423:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100151680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727467.127438:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae01538c00/0x8db73d43f55049b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55049b9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727467.127448:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae01538c00/0x8db73d43f55049b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f55049b9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727467.127500:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100151808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727467.127527:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727467.127539:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0305ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727467.127601:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100151808 00000100:00100000:2.0:1782727467.127615:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100151808 00000100:00100000:2.0:1782727467.127647:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782727467.127653:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:5949:x1869325100151808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727467.127757:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:5949:x1869325100151808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727467.127764:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1782727467.127831:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100151808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727467.127857:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100151936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727467.127891:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727467.127916:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0305ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727467.127960:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100151936 00000100:00100000:2.0:1782727467.127964:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100151936 00000100:00100000:2.0:1782727467.128031:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782727467.128038:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:5949:x1869325100151936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727467.128113:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:5949:x1869325100151936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727467.128119:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782727467.128492:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100151936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727467.128822:0:8839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e006a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8839:1869325100152064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727467.128862:0:8839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727467.128894:0:8839:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3db07b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782727467.128942:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100152064 00000100:00100000:3.0:1782727467.128947:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100152064 00000100:00100000:3.0:1782727467.128979:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1782727467.129078:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:8839:x1869325100152064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727467.129246:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:8839:x1869325100152064:12345-0@lo:502:llog_process_th.0 Request processed in 259us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727467.129253:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1782727467.129324:0:8839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e006a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8839:1869325100152064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782727467.129346:0:8839:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727467.129355:0:8839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727467.129357:0:8839:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782727467.129362:0:8839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782727467.129457:0:8839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e006a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8839:1869325100152192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727467.129491:0:8839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727467.129519:0:8839:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3db07b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782727467.129564:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100152192 00000100:00100000:3.0:1782727467.129574:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100152192 00000100:00100000:3.0:1782727467.129617:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782727467.129623:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:8839:x1869325100152192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727467.129730:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:8839:x1869325100152192:12345-0@lo:502:llog_process_th.0 Request processed in 107us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727467.129737:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1782727467.129866:0:8839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e006a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8839:1869325100152192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782727467.129886:0:8839:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727467.129890:0:8839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727467.129892:0:8839:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782727467.129896:0:8839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1782727467.130138:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1782727467.130237:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782727467.130246:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae01538c00/0x8db73d43f55049b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55049b9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727467.130256:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae01538c00/0x8db73d43f55049b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55049b9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727467.130265:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782727467.130268:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff90ae052c9800 from 39 10000000:01000000:3.0:1782727467.130271:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782727467.130293:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae01538600/0x8db73d43f55049c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727467.130301:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae01538600/0x8db73d43f55049c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727467.130310:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae01538600/0x8db73d43f55049c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727467.130323:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100152320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782727467.130350:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727467.130482:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0305c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727467.130574:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100152320 00000100:00100000:0.0:1782727467.130579:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100152320 00000100:00100000:0.0:1782727467.130647:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782727467.130663:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:5949:x1869325100152320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727467.130674:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727467.130686:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae00031600/0x8db73d43f55049c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f55049c0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727467.130706:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae00031600/0x8db73d43f55049c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f55049c0 expref: 17 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727467.130716:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae00031600/0x8db73d43f55049c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55049c0 expref: 17 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727467.130725:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae00031600, rc 0) 00000100:00100000:0.0:1782727467.130765:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100152320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727467.130771:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1782727467.130827:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100152320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727467.130840:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae01538600/0x8db73d43f55049c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55049c7 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727467.130855:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae01538600/0x8db73d43f55049c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f55049c7 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727467.130909:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100152448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727467.130938:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727467.131101:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3422ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727467.131298:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100152448 00000100:00100000:3.0:1782727467.131303:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100152448 00000100:00100000:3.0:1782727467.131324:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1782727467.131330:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100152448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727467.131466:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100152448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727467.131473:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1782727467.131562:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100152448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727467.131588:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100152576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727467.131636:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727467.131658:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3422ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727467.131751:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100152576 00000100:00100000:0.0:1782727467.131756:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100152576 00000100:00100000:0.0:1782727467.131775:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1782727467.131781:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100152576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727467.131863:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100152576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727467.131869:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782727467.132010:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100152576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727467.132860:0:8840:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f53800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8840:1869325100152704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727467.132907:0:8840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727467.132946:0:8840:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3422c000 going to sleep for 11 seconds 00000100:00100000:3.0:1782727467.133004:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100152704 00000100:00100000:3.0:1782727467.133009:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100152704 00000100:00100000:3.0:1782727467.133047:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1782727467.133054:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:8840:x1869325100152704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727467.133145:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:8840:x1869325100152704:12345-0@lo:502:llog_process_th.0 Request processed in 91us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727467.133153:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782727467.133313:0:8840:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f53800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8840:1869325100152704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727467.133356:0:8840:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f53800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8840:1869325100152832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727467.133426:0:8840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727467.133439:0:8840:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3422c000 going to sleep for 11 seconds 00000100:00100000:3.0:1782727467.133538:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100152832 00000100:00100000:3.0:1782727467.133543:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100152832 00000100:00100000:3.0:1782727467.133574:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1782727467.133580:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:8840:x1869325100152832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727467.133656:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:8840:x1869325100152832:12345-0@lo:502:llog_process_th.0 Request processed in 75us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727467.133663:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1782727467.133743:0:8840:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f53800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8840:1869325100152832:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1782727467.133763:0:8840:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1782727467.133935:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1782727467.133965:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782727467.133974:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae01538600/0x8db73d43f55049c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55049c7 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727467.134060:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae01538600/0x8db73d43f55049c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55049c7 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727467.134078:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782727467.134081:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1782727467.134084:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782727467.134109:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f55049ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727467.134116:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f55049ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727467.134125:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f55049ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727467.134139:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100152960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782727467.134168:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727467.134237:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e538600 going to sleep for 11 seconds 00000100:00100000:2.0:1782727467.134348:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100152960 00000100:00100000:2.0:1782727467.134353:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100152960 00000100:00100000:1.0:1782727467.134561:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1782727467.134569:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100152960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727467.134585:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727467.134597:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae37da6000/0x8db73d43f55049d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f55049ce expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727467.134629:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae37da6000/0x8db73d43f55049d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f55049ce expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727467.134638:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae37da6000/0x8db73d43f55049d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55049ce expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727467.134646:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae37da6000, rc 0) 00000100:00100000:1.0:1782727467.134690:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100152960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727467.134696:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1782727467.134767:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100152960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727467.134779:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f55049ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55049d5 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727467.134788:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f55049ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f55049d5 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727467.134839:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100153088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727467.134863:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727467.134892:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e538600 going to sleep for 11 seconds 00000100:00100000:1.0:1782727467.134966:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100153088 00000100:00100000:1.0:1782727467.134971:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100153088 00000100:00100000:1.0:1782727467.135088:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1782727467.135096:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100153088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727467.135215:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100153088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727467.135222:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1782727467.135318:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100153088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727467.135348:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e007100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100153216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727467.135426:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727467.135445:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3db07480 going to sleep for 11 seconds 00000100:00100000:1.0:1782727467.135510:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100153216 00000100:00100000:1.0:1782727467.135515:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100153216 00000100:00100000:1.0:1782727467.135578:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1782727467.135585:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100153216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727467.135679:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100153216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727467.135695:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1782727467.135764:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e007100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100153216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727467.136358:0:8841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e007100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8841:1869325100153344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727467.136767:0:8841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727467.136801:0:8841:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3db07b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782727467.136862:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100153344 00000100:00100000:1.0:1782727467.136867:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100153344 00000100:00100000:1.0:1782727467.136892:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1782727467.136899:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:8841:x1869325100153344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727467.137082:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:8841:x1869325100153344:12345-0@lo:502:llog_process_th.0 Request processed in 182us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727467.137090:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1782727467.137171:0:8841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e007100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8841:1869325100153344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782727467.137196:0:8841:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727467.137206:0:8841:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727467.137208:0:8841:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782727467.137212:0:8841:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782727467.137235:0:8841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e007100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8841:1869325100153472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727467.137266:0:8841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727467.137286:0:8841:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3db07b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782727467.137320:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100153472 00000100:00100000:1.0:1782727467.137323:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100153472 00000100:00100000:1.0:1782727467.137339:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1782727467.137344:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:8841:x1869325100153472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727467.137433:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:8841:x1869325100153472:12345-0@lo:502:llog_process_th.0 Request processed in 89us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727467.137440:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1782727467.137512:0:8841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e007100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8841:1869325100153472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782727467.137530:0:8841:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727467.137533:0:8841:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727467.137534:0:8841:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782727467.137537:0:8841:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1782727467.137694:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1782727467.137721:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782727467.137730:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f55049ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55049d5 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727467.137738:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae01539400/0x8db73d43f55049ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55049d5 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727467.137746:0:5949:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1782727467.137749:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff90ae0f4f0000 from 1 10000000:01000000:1.0:1782727467.137751:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782727467.137773:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae37da7000/0x8db73d43f55049dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727467.137786:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae37da7000/0x8db73d43f55049dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727467.137794:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae37da7000/0x8db73d43f55049dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727467.137807:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100153600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782727467.137833:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727467.137866:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3422c180 going to sleep for 11 seconds 00000100:00100000:2.0:1782727467.137926:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100153600 00000100:00100000:2.0:1782727467.137930:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100153600 00000100:00100000:2.0:1782727467.137951:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1782727467.137957:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100153600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727467.137965:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727467.137979:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae0a3c7400/0x8db73d43f55049e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f55049dc expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727467.138071:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae0a3c7400/0x8db73d43f55049e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f55049dc expref: 19 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727467.138081:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae0a3c7400/0x8db73d43f55049e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55049dc expref: 19 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727467.138099:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae0a3c7400, rc 0) 00000100:00100000:2.0:1782727467.138139:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:5949:x1869325100153600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727467.138144:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1782727467.138236:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100153600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727467.138249:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae37da7000/0x8db73d43f55049dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55049e3 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727467.138257:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae37da7000/0x8db73d43f55049dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f55049e3 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727467.138306:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100153728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727467.138331:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727467.138565:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3422c180 going to sleep for 11 seconds 00000100:00100000:2.0:1782727467.138621:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100153728 00000100:00100000:2.0:1782727467.138626:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100153728 00000100:00100000:2.0:1782727467.138658:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1782727467.138665:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:5949:x1869325100153728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727467.138735:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:5949:x1869325100153728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (403us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782727467.138742:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1782727467.142529:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100153728:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1782727467.142592:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782727467.142615:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae37da7000/0x8db73d43f55049dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55049e3 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727467.142626:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae37da7000/0x8db73d43f55049dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55049e3 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727467.309819:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727467.310109:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080204544 00000100:00100000:0.0:1782727467.310119:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080204544 00000100:00100000:0.0:1782727467.310213:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00100000:0.0:1782727467.310224:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2350:x1869325080204544:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1782727467.310320:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2350:x1869325080204544:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 98us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727467.310329:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00080000:1.0:1782727467.310816:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727467.312840:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727467.312924:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727467.313525:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080204672 00000100:00100000:2.0:1782727467.313535:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080204672 00000100:00100000:2.0:1782727467.313616:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080204800 00000100:00100000:2.0:1782727467.313620:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080204800 00000100:00100000:2.0:1782727467.313638:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:2.0:1782727467.313647:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2350:x1869325080204672:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1782727467.313729:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2350:x1869325080204672:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 83us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727467.313736:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:2.0:1782727467.313755:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:2.0:1782727467.313761:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2351:x1869325080204800:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1782727467.313786:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2351:x1869325080204800:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 26us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727467.313811:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00080000:1.0:1782727467.315620:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727467.315630:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727467.685797:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100153856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727467.685891:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727467.685999:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100153856 00000100:00100000:3.0:1782727467.686007:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100153856 00000100:00100000:3.0:1782727467.686078:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782727467.686087:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100153856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727467.686119:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727467.686170:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100153856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727467.686178:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1782727467.686316:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b0ece00 x1869325100153856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727467.686342:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100153856:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1782727467.686447:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727467.686699:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727467.686709:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3444:1869325100154368:0@lo:400:kworker.0 00000100:00100000:2.0:1782727467.686725:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3446:1869325100154112:0@lo:400:kworker.0 00000100:00100000:0.0:1782727467.686743:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727467.686772:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100154240:0@lo:400:kworker.0 00000100:00100000:2.0:1782727467.686777:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727467.686796:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727467.686796:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727467.686802:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869325100153984:0@lo:400:kworker.0 00000100:00100000:0.0:1782727467.686825:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100154368 00000100:00100000:0.0:1782727467.686829:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100154368 00000100:00100000:2.0:1782727467.686834:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727467.686854:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100154112 00000100:00100000:0.0:1782727467.686857:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100154112 00000100:00100000:2.0:1782727467.686867:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100153984 00000100:00100000:2.0:1782727467.686870:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100153984 00000100:00100000:0.0:1782727467.686872:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782727467.686878:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869325100154368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727467.686885:0:5952:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1782727467.686891:0:5952:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1782727467.686906:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100154240 00000100:00100000:2.0:1782727467.686909:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100154240 00000100:00100000:0.0:1782727467.686915:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869325100154368:12345-0@lo:400:kworker.0 Request processed in 38us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727467.686922:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782727467.686936:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782727467.686942:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869325100154112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727467.686943:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782727467.686956:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100154240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727467.686974:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869325100154112:12345-0@lo:400:kworker.0 Request processed in 33us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727467.686981:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782727467.686984:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100154240:12345-0@lo:400:kworker.0 Request processed in 36us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727467.686989:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782727467.686992:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782727467.686998:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869325100153984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727467.687012:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3446:1869325100154112:0@lo:400:kworker.0 00000100:00100000:0.0:1782727467.687022:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869325100153984:12345-0@lo:400:kworker.0 Request processed in 25us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727467.687028:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869325100153984:0@lo:400:kworker.0 00000100:00100000:0.0:1782727467.687028:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782727467.687058:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3444:1869325100154368:0@lo:400:kworker.0 00000100:00080000:1.0:1782727467.687284:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782727467.687547:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b0ece00 x1869325100154240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727467.687558:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100154240:0@lo:400:kworker.0 00010000:00010000:3.0:1782727468.070363:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782727468.610122:0:8879:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce588cdf0 20000000:00000080:3.0:1782727468.610142:0:8879:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90ae3dde6c00 uarg=0000000000000000 20000000:01000000:3.0:1782727468.610192:0:8879:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1782727468.610200:0:8879:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1782727468.610204:0:8879:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1782727468.611173:0:8880:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1782727468.611356:0:8879:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1782727468.618290:0:8879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1782727468.618324:0:8879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1782727468.618341:0:8879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1782727468.618354:0:8879:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782727468.619022:0:8879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90ae01539c00/0x8db73d43f55049ea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727468.619042:0:8879:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae01538800/0x8db73d43f550475f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504758 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727468.619051:0:8879:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae00031c00/0x8db73d43f55047c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55047ba expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727468.619058:0:8879:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae01538000/0x8db73d43f550488c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504885 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727468.619082:0:8879:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae0a3c6c00/0x8db73d43f5504949 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735779b expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727468.619091:0:8879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90ae01539c00/0x8db73d43f55049ea lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727468.619130:0:8879:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae0a3c6c00/0x8db73d43f5504949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x9cd528c39735779b expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727468.619144:0:8879:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90ae0a3c6c00/0x8db73d43f5504949 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c39735779b expref: 9 pid: 5944 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727468.619160:0:8879:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8879:1869325100154496:192.168.204.35@tcp:104: 00010000:00010000:3.0:1782727468.619325:0:8879:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae01538000/0x8db73d43f550488c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f5504885 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727468.619335:0:8879:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae01538000/0x8db73d43f550488c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f5504885 expref: 18 pid: 5947 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727468.619346:0:8879:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8879:1869325100154624:0@lo:104: 00000100:00100000:3.0:1782727468.619407:0:8879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782727468.619443:0:8879:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae00031c00/0x8db73d43f55047c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f55047ba expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727468.619452:0:8879:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae00031c00/0x8db73d43f55047c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f55047ba expref: 18 pid: 5947 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727468.619460:0:8879:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8879:1869325100154752:0@lo:104: 00000100:00100000:3.0:1782727468.619491:0:8879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782727468.619524:0:8879:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae01538800/0x8db73d43f550475f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f5504758 expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727468.619533:0:8879:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae01538800/0x8db73d43f550475f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f5504758 expref: 18 pid: 5946 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727468.619541:0:8879:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8879:1869325100154880:0@lo:104: 00000100:00100000:3.0:1782727468.619558:0:8879:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae2e538240 going to sleep for 11 seconds 00000100:00100000:1.0:1782727468.619662:0:5935:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782727468.619683:0:5935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727468.619695:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100154624 00000100:00100000:1.0:1782727468.619702:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100154624 00000100:00100000:1.0:1782727468.619748:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100154752 00000100:00100000:1.0:1782727468.619751:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100154752 00000100:00100000:1.0:1782727468.619769:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100154880 00000100:00100000:1.0:1782727468.619772:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100154880 00000100:00100000:1.0:1782727468.619785:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782727468.619792:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+5:8879:x1869325100154624:12345-0@lo:104: 00010000:00010000:1.0:1782727468.619805:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f5504885 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f550488c expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.619868:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782727468.619874:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+5:8879:x1869325100154624:12345-0@lo:104: Request processed in 82us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727468.619881:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782727468.619898:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782727468.619903:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2e474850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+4:8879:x1869325100154752:12345-0@lo:104: 00010000:00010000:1.0:1782727468.619911:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae013a1200/0x8db73d43f55047ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f55047c1 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.619942:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782727468.619953:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2e474850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+4:8879:x1869325100154752:12345-0@lo:104: Request processed in 50us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727468.619958:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782727468.619990:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782727468.619995:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:8879:x1869325100154880:12345-0@lo:104: 00010000:00010000:1.0:1782727468.620002:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7a00/0x8db73d43f5504758 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f550475f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620035:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782727468.620040:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:8879:x1869325100154880:12345-0@lo:104: Request processed in 45us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727468.620044:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1782727468.620065:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782727468.620070:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f5504885 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f550488c expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620077:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae0a3c7000 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:1.0:1782727468.620081:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f5504885 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f550488c expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620088:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f5504885 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f550488c expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727468.620095:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f5504885 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f550488c expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727468.620100:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782727468.620131:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f5504885 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f550488c expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620149:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727468.620171:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f5504885 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f550488c expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620178:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7000/0x8db73d43f5504885 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f550488c expref: -99 pid: 8007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620191:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782727468.620195:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae013a1200/0x8db73d43f55047ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f55047c1 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620200:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae013a1200 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:1.0:1782727468.620202:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae013a1200/0x8db73d43f55047ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f55047c1 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620208:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae013a1200/0x8db73d43f55047ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f55047c1 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727468.620213:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae013a1200/0x8db73d43f55047ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f55047c1 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727468.620217:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782727468.620232:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae013a1200/0x8db73d43f55047ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55047c1 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620237:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727468.620243:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae013a1200/0x8db73d43f55047ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55047c1 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620248:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae013a1200/0x8db73d43f55047ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55047c1 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620263:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727468.620265:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7a00/0x8db73d43f5504758 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f550475f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620270:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae0a3c7a00 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:1.0:1782727468.620272:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7a00/0x8db73d43f5504758 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f550475f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620277:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7a00/0x8db73d43f5504758 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f550475f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727468.620282:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7a00/0x8db73d43f5504758 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f550475f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727468.620288:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782727468.620302:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7a00/0x8db73d43f5504758 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f550475f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620307:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727468.620321:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7a00/0x8db73d43f5504758 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f550475f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620327:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae0a3c7a00/0x8db73d43f5504758 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f550475f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620338:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727468.620340:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727468.620341:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727468.620347:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727468.620359:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727468.620412:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100155008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782727468.620431:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100155136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782727468.620449:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727468.620471:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727468.620498:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100155264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782727468.620513:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100155008 00000100:00100000:2.0:1782727468.620519:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100155008 00000100:00100000:1.0:1782727468.620526:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782727468.620543:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae01538000/0x8db73d43f550488c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f5504885 expref: 19 pid: 5947 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727468.620558:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100155136 00000100:00100000:1.0:1782727468.620563:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100155136 00000100:00100000:2.0:1782727468.620597:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100155264 00010000:00010000:1.0:1782727468.620598:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae00031c00/0x8db73d43f55047c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55047ba expref: 20 pid: 5947 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727468.620602:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100155264 00010000:00010000:2.0:1782727468.620619:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae01538800/0x8db73d43f550475f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f5504758 expref: 21 pid: 5946 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727468.620623:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782727468.620636:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3daf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+21:3445:x1869325100155008:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782727468.620641:0:5938:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1782727468.620648:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782727468.620649:0:5938:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1782727468.620655:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae01538000/0x8db73d43f550488c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f5504885 expref: 21 pid: 5947 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620665:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae01538000/0x8db73d43f550488c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f5504885 expref: 21 pid: 5947 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620680:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727468.620717:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3daf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+21:3445:x1869325100155008:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727468.620723:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782727468.620738:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782727468.620743:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+20:3446:x1869325100155136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782727468.620751:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727468.620755:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae00031c00/0x8db73d43f55047c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55047ba expref: 20 pid: 5947 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620774:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae00031c00/0x8db73d43f55047c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f55047ba expref: 20 pid: 5947 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620784:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727468.620814:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+20:3446:x1869325100155136:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727468.620820:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782727468.620833:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782727468.620838:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dafb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100155264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782727468.620847:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727468.620851:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae01538800/0x8db73d43f550475f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f5504758 expref: 19 pid: 5946 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620858:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae01538800/0x8db73d43f550475f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f5504758 expref: 19 pid: 5946 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.620867:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727468.620892:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dafb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100155264:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727468.620898:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782727468.620939:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100155136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782727468.620963:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100155264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782727468.621134:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100155008:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782727468.621269:0:8879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae01538000/0x8db73d43f550488c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f5504885 expref: 18 pid: 5947 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727468.621280:0:8879:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8879:1869325100154624:0@lo:104: 00010000:00010000:3.0:1782727468.621290:0:8879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae00031c00/0x8db73d43f55047c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f55047ba expref: 17 pid: 5947 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727468.621300:0:8879:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8879:1869325100154752:0@lo:104: 00010000:00010000:3.0:1782727468.621309:0:8879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae01538800/0x8db73d43f550475f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f5504758 expref: 16 pid: 5946 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727468.621317:0:8879:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8879:1869325100154880:0@lo:104: 00000100:00100000:3.0:1782727468.625225:0:8879:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8879:1869325100154496:192.168.204.35@tcp:104: 00010000:00010000:3.0:1782727468.625267:0:8879:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90ae01539c00/0x8db73d43f55049ea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727468.626701:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727468.626859:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080204928 00000100:00100000:1.0:1782727468.626869:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080204928 00010000:00010000:1.0:1782727468.626906:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae0a3c6c00/0x8db73d43f5504949 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c39735779b expref: 10 pid: 5944 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727468.626966:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 24 00000100:00100000:1.0:1782727468.626976:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2350:x1869325080204928:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782727468.626991:0:5937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727468.626996:0:5937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae0a3c6c00/0x8db73d43f5504949 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c39735779b expref: 10 pid: 5944 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.627006:0:5937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae0a3c6c00/0x8db73d43f5504949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c39735779b expref: 10 pid: 5944 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.627023:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae0a3c6c00/0x8db73d43f5504949 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c39735779b expref: 10 pid: 5944 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.627039:0:5937:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90ae01539c00/0x8db73d43f55049ea lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.627047:0:5937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae01539c00/0x8db73d43f55049ea lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.627063:0:5937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ae01539c00/0x8db73d43f55049ea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.627070:0:5937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ae01539c00/0x8db73d43f55049ea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.627077:0:5937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90ae01539c00/0x8db73d43f55049ea lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.627083:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90ae01539c00/0x8db73d43f55049ea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.627098:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01539c00 already unused, calling callback (ffffffffc0b2bcf0) 00010000:00010000:1.0:1782727468.627102:0:5937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90ae01539c00/0x8db73d43f55049ea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.627109:0:5937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90ae01539c00/0x8db73d43f55049ea lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.627129:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90ae01539c00/0x8db73d43f55049ea lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.627140:0:5937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727468.627203:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+9:2350:x1869325080204928:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 227us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727468.627211:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 24 00010000:00010000:3.0:1782727468.627442:0:8879:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90ae01539c00/0x8db73d43f55049ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727468.627465:0:8879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90ae01539c00/0x8db73d43f55049ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727468.627481:0:8879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae01539c00/0x8db73d43f55049ea lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727468.933517:0:5949:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782727468.933525:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff90ae3dae6000 from 4 10000000:01000000:1.0:1782727468.933530:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782727468.933591:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55049f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.933603:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55049f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.933614:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55049f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727468.933640:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3daf8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100155392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782727468.933710:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727468.933879:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100155392 00000100:00100000:2.0:1782727468.933887:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100155392 00000100:00100000:2.0:1782727468.933945:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1782727468.933954:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:5949:x1869325100155392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727468.933966:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727468.933980:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae033b8400/0x8db73d43f55049f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f55049f1 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727468.934018:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae033b8400/0x8db73d43f55049f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f55049f1 expref: 17 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727468.934028:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae033b8400/0x8db73d43f55049f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55049f1 expref: 17 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727468.934037:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae033b8400, rc 0) 00000100:00100000:2.0:1782727468.934080:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100155392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727468.934087:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1782727468.934320:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae34377240 going to sleep for 11 seconds 00000100:00100000:1.0:1782727468.934354:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3daf8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100155392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727468.934366:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55049f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55049f8 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.934398:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55049f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f55049f8 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727468.934458:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3daf8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100155520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727468.934481:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727468.936422:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100155520 00000100:00100000:0.0:1782727468.936439:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100155520 00000100:00100000:0.0:1782727468.936555:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1782727468.936565:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100155520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727468.936728:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100155520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (2246us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727468.936735:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1782727468.937300:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae34377240 going to sleep for 11 seconds 00000100:00100000:1.0:1782727468.937326:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3daf8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100155520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727468.937402:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3daf8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100155648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727468.937464:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727468.943859:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae34377240 going to sleep for 11 seconds 00000100:00100000:3.0:1782727468.946025:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100155648 00000100:00100000:3.0:1782727468.946046:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100155648 00000100:00100000:3.0:1782727468.946110:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1782727468.946121:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100155648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727468.946312:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100155648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 192us (8847us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727468.946320:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1782727468.946584:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3daf8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100155648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727468.947310:0:8893:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3daf8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8893:1869325100155776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727468.947367:0:8893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727468.947582:0:8893:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae34377f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782727468.947643:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100155776 00000100:00100000:3.0:1782727468.947649:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100155776 00000100:00100000:3.0:1782727468.947678:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1782727468.947685:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:8893:x1869325100155776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727468.947807:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:8893:x1869325100155776:12345-0@lo:502:llog_process_th.0 Request processed in 121us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727468.947815:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1782727468.950074:0:8893:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3daf8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8893:1869325100155776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782727468.950126:0:8893:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727468.950139:0:8893:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727468.950141:0:8893:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782727468.950149:0:8893:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff90ae3dae6000 00000020:00000080:1.0:1782727468.950151:0:8893:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782727468.950256:0:8893:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3daf8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8893:1869325100155904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727468.950335:0:8893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727468.950417:0:8893:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae063116c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727468.952348:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100155904 00000100:00100000:3.0:1782727468.952361:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100155904 00000100:00100000:3.0:1782727468.952436:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1782727468.952445:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:8893:x1869325100155904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727468.952612:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:8893:x1869325100155904:12345-0@lo:502:llog_process_th.0 Request processed in 168us (2277us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727468.952620:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1782727468.954200:0:8893:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3daf8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8893:1869325100155904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782727468.954238:0:8893:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727468.954246:0:8893:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727468.954248:0:8893:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1782727468.954253:0:8893:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1782727468.954501:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1782727468.954537:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782727468.954548:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55049f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55049f8 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727468.954558:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55049f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f55049f8 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727468.954579:0:5949:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782727468.954581:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff90ae06bcd800 from 4 10000000:01000000:2.0:1782727468.954584:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782727468.954616:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae033b8000/0x8db73d43f55049ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727468.954624:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae033b8000/0x8db73d43f55049ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727468.954633:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae033b8000/0x8db73d43f55049ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727468.954652:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df91c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100156032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782727468.954707:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727468.954749:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b2ba480 going to sleep for 11 seconds 00000100:00100000:1.0:1782727468.954857:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100156032 00000100:00100000:1.0:1782727468.954863:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100156032 00000100:00100000:1.0:1782727468.954905:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1782727468.954912:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100156032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727468.954923:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727468.954935:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae37da6a00/0x8db73d43f5504a06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f55049ff expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.954957:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae37da6a00/0x8db73d43f5504a06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f55049ff expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.954966:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae37da6a00/0x8db73d43f5504a06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55049ff expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.954974:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae37da6a00, rc 0) 00000100:00100000:1.0:1782727468.955007:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100156032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727468.955027:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1782727468.955312:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df91c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100156032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727468.955325:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae033b8000/0x8db73d43f55049ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504a06 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727468.955333:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae033b8000/0x8db73d43f55049ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f5504a06 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727468.955523:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df91c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100156160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727468.955562:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727468.955654:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b2ba480 going to sleep for 11 seconds 00000100:00100000:1.0:1782727468.960320:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100156160 00000100:00100000:1.0:1782727468.960335:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100156160 00000100:00100000:0.0:1782727468.960593:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1782727468.960608:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100156160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727468.960941:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100156160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 337us (5378us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727468.960949:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1782727468.962936:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df91c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100156160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727468.963219:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df91c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100156288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727468.963293:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727468.963705:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100156288 00000100:00100000:0.0:1782727468.963714:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100156288 00000100:00100000:0.0:1782727468.963787:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1782727468.963798:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100156288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727468.963942:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100156288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727468.963949:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1782727468.968176:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b2ba480 going to sleep for 11 seconds 00000100:00100000:2.0:1782727468.968232:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df91c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100156288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727468.971468:0:8896:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8896:1869325100156416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727468.971560:0:8896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727468.971713:0:8896:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae03e71cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727468.971765:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100156416 00000100:00100000:2.0:1782727468.971773:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100156416 00000100:00100000:2.0:1782727468.971820:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1782727468.971831:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:8896:x1869325100156416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727468.972027:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:8896:x1869325100156416:12345-0@lo:502:llog_process_th.0 Request processed in 196us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727468.972043:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1782727468.972351:0:8896:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8896:1869325100156416:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782727468.972399:0:8896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727468.972410:0:8896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727468.972413:0:8896:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782727468.972420:0:8896:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff90ae06bcd800 00000020:00000080:3.0:1782727468.972423:0:8896:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782727468.972499:0:8896:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8896:1869325100156544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727468.972538:0:8896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727468.972564:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100156544 00000100:00100000:0.0:1782727468.973554:0:8896:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae03e71cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727468.975868:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100156544 00000100:00100000:3.0:1782727468.975936:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1782727468.975947:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:8896:x1869325100156544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727468.977293:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:8896:x1869325100156544:12345-0@lo:502:llog_process_th.0 Request processed in 1344us (4750us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727468.977307:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1782727468.977338:0:8896:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8896:1869325100156544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782727468.977512:0:8896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727468.977520:0:8896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727468.977523:0:8896:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1782727468.977528:0:8896:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782727468.978201:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782727468.978224:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782727468.978237:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae033b8000/0x8db73d43f55049ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504a06 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727468.978250:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae033b8000/0x8db73d43f55049ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504a06 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727468.978261:0:5949:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782727468.978264:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff90ae052c9800 from 4 10000000:01000000:3.0:1782727468.978267:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782727468.978311:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727468.978319:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727468.978328:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727468.978350:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100156672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782727468.978422:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727468.978458:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae03e716c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727468.978546:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100156672 00000100:00100000:2.0:1782727468.978555:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100156672 00000100:00100000:2.0:1782727468.978709:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1782727468.978719:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100156672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727468.978732:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727468.978745:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae033b9000/0x8db73d43f5504a14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f5504a0d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727468.978768:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae033b9000/0x8db73d43f5504a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f5504a0d expref: 19 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727468.978779:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae033b9000/0x8db73d43f5504a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504a0d expref: 19 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727468.978794:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae033b9000, rc 0) 00000100:00100000:2.0:1782727468.978841:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:5949:x1869325100156672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727468.978847:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1782727468.978985:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae035be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100156672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727468.979000:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504a14 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727468.979008:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f5504a14 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727468.979069:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3daf8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100156800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727468.979097:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727468.979124:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae063116c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727468.979156:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100156800 00000100:00100000:3.0:1782727468.979161:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100156800 00000100:00100000:3.0:1782727468.979201:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1782727468.979209:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:5949:x1869325100156800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727468.979321:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:5949:x1869325100156800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727468.979328:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1782727468.979495:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3daf8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100156800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727468.979680:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3daf8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100156928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727468.979720:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727468.979747:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae063116c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727468.980180:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100156928 00000100:00100000:2.0:1782727468.980186:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100156928 00000100:00100000:2.0:1782727468.980226:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1782727468.980234:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:5949:x1869325100156928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727468.980334:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:5949:x1869325100156928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727468.980342:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1782727468.980486:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3daf8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100156928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727468.983115:0:8898:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8898:1869325100157056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727468.983200:0:8898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727468.983250:0:8898:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b2ba600 going to sleep for 11 seconds 00000100:00100000:3.0:1782727468.983404:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100157056 00000100:00100000:3.0:1782727468.983411:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100157056 00000100:00100000:3.0:1782727468.983458:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1782727468.983467:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:8898:x1869325100157056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727468.983597:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:8898:x1869325100157056:12345-0@lo:502:llog_process_th.0 Request processed in 129us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727468.983605:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1782727468.983918:0:8898:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8898:1869325100157056:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782727468.983945:0:8898:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782727468.983954:0:8898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727468.983956:0:8898:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1782727468.983962:0:8898:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff90ae052c9800 00000020:00000080:2.0:1782727468.983965:0:8898:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782727468.984064:0:8898:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8898:1869325100157184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727468.984100:0:8898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727468.984121:0:8898:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b2ba600 going to sleep for 11 seconds 00000100:00100000:3.0:1782727468.984234:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100157184 00000100:00100000:3.0:1782727468.984239:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100157184 00000100:00100000:3.0:1782727468.984281:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1782727468.984289:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:8898:x1869325100157184:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727468.984363:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:8898:x1869325100157184:12345-0@lo:502:llog_process_th.0 Request processed in 74us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727468.984396:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1782727468.984826:0:8898:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0332f07-5c7b-4a87-aafc-b3671573fb48:8898:1869325100157184:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782727468.984845:0:8898:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782727468.984854:0:8898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727468.984856:0:8898:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1782727468.984860:0:8898:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782727468.985131:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782727468.985159:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782727468.985170:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504a14 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727468.985180:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504a14 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727469.093626:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727469.870480:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727469.876476:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080205056 00000100:00100000:2.0:1782727469.876491:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080205056 00000100:00100000:2.0:1782727469.879939:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 184 00000100:00100000:2.0:1782727469.879963:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+9:5441:x1869325080205056:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727469.879982:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727469.880003:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae033b8e00/0x8db73d43f5504a1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cd528c3973577da expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727469.880038:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae033b8e00/0x8db73d43f5504a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577da expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727469.880051:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae033b8e00/0x8db73d43f5504a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577da expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727469.880062:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae033b8e00, rc 0) 00000100:00100000:2.0:1782727469.880146:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5441:x1869325080205056:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 193us (9680us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727469.880155:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 184 00000100:00100000:0.0:1782727469.894305:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727469.894611:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080205184 00000100:00100000:0.0:1782727469.894625:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080205184 00000100:00100000:0.0:1782727469.894694:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 185 00000100:00100000:0.0:1782727469.894706:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5441:x1869325080205184:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727469.895806:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5441:x1869325080205184:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 813us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727469.895820:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 185 00000100:00100000:0.0:1782727469.899087:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727469.899986:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080205312 00000100:00100000:0.0:1782727469.900003:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080205312 00000100:00100000:0.0:1782727469.900093:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 186 00000100:00100000:0.0:1782727469.900617:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5441:x1869325080205312:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727469.901077:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5441:x1869325080205312:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 972us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727469.901088:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 186 00000100:00100000:0.0:1782727469.908002:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727469.909544:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080205440 00000100:00100000:1.0:1782727469.909571:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080205440 00000100:00100000:1.0:1782727469.909655:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 187 00000100:00100000:1.0:1782727469.909670:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5978:x1869325080205440:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782727469.909876:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5978:x1869325080205440:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 209us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727469.909893:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 187 00000100:00100000:0.0:1782727469.925334:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727469.925542:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080205568 00000100:00100000:2.0:1782727469.925565:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080205568 00000100:00100000:2.0:1782727469.925646:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 188 00000100:00100000:2.0:1782727469.925658:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5978:x1869325080205568:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782727469.925858:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5978:x1869325080205568:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 202us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727469.925874:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 188 00010000:00010000:1.0:1782727470.118436:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727471.142044:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727471.271185:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782727471.271217:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100157312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727471.271333:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727471.274616:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100157312 00000100:00100000:2.0:1782727471.274638:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100157312 00000100:00100000:2.0:1782727471.274756:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782727471.274769:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3daf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100157312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727471.274825:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00080000:1.0:1782727471.274980:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727471.276107:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3daf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100157312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1333us (4766us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727471.276123:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1782727471.277173:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3df91c00 x1869325100157312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727471.277208:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100157312:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782727472.165887:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727472.428476:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727472.428531:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727472.428633:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080205824 00000100:00100000:1.0:1782727472.428650:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080205824 00000100:00100000:3.0:1782727472.428656:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727472.428759:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 30 00000100:00100000:1.0:1782727472.428774:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2351:x1869325080205824:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1782727472.428799:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727472.428901:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2351:x1869325080205824:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 129us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727472.428911:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 30 00000100:00100000:1.0:1782727472.428942:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080205696 00000100:00100000:1.0:1782727472.428946:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080205696 00000100:00100000:1.0:1782727472.428975:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 189 00000100:00100000:1.0:1782727472.428982:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2351:x1869325080205696:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1782727472.429009:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2351:x1869325080205696:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 27us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727472.429016:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 189 00000100:00080000:1.0:1782727472.429060:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727472.431963:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080206080 00000100:00100000:1.0:1782727472.431965:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080205952 00000100:00100000:1.0:1782727472.431982:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080205952 00000100:00100000:2.0:1782727472.431983:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080206080 00000100:00100000:1.0:1782727472.432153:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:1.0:1782727472.432166:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2351:x1869325080205952:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1782727472.432268:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2351:x1869325080205952:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 106us (3470us total) trans 0 rc 0/0 00000100:00080000:3.0:1782727472.432298:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782727472.432305:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782727472.432347:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:1.0:1782727472.432369:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:1.0:1782727472.432414:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2351:x1869325080206080:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1782727472.432442:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2351:x1869325080206080:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 31us (3911us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727472.432449:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:0.0:1782727472.805663:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100157440:0@lo:400:kworker.0 00000100:00100000:0.0:1782727472.805744:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727472.808479:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100157440 00000100:00100000:1.0:1782727472.808503:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100157440 00000100:00100000:1.0:1782727472.808560:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1782727472.808570:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3445:x1869325100157440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727472.810862:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869325100157568:0@lo:400:kworker.0 00000100:00100000:2.0:1782727472.810929:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727472.810959:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100158080:0@lo:400:kworker.0 00000100:00100000:2.0:1782727472.810982:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727472.811005:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727472.811009:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1869325100157952:0@lo:400:kworker.0 00000100:00100000:2.0:1782727472.811028:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727472.811076:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325100157696:0@lo:400:kworker.0 00000100:00100000:2.0:1782727472.811099:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727472.811118:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727472.811123:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100157824:0@lo:400:kworker.0 00000100:00100000:2.0:1782727472.811143:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727472.811174:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100157568 00000100:00100000:2.0:1782727472.811180:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100157568 00000100:00100000:2.0:1782727472.811217:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100157952 00000100:00100000:2.0:1782727472.811219:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100157952 00000100:00100000:2.0:1782727472.811239:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100157696 00000100:00100000:2.0:1782727472.811241:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100157696 00000100:00100000:2.0:1782727472.811269:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782727472.811276:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869325100157568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727472.811323:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869325100157568:12345-0@lo:400:kworker.0 Request processed in 47us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727472.811330:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782727472.811349:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782727472.811355:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869325100157952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727472.811403:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869325100157952:12345-0@lo:400:kworker.0 Request processed in 48us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727472.811409:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782727472.811419:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782727472.811426:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325100157696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727472.811452:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325100157696:12345-0@lo:400:kworker.0 Request processed in 28us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727472.811457:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782727472.811473:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100158080 00000100:00100000:2.0:1782727472.811475:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100158080 00000100:00100000:2.0:1782727472.811511:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100157824 00000100:00100000:2.0:1782727472.811514:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100157824 00000100:00100000:2.0:1782727472.811526:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782727472.811531:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100158080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727472.811557:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100158080:12345-0@lo:400:kworker.0 Request processed in 26us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727472.811563:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782727472.811571:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782727472.811576:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100157824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727472.811620:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100157824:12345-0@lo:400:kworker.0 Request processed in 43us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727472.811625:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1782727472.811663:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782727472.811667:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727472.811696:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1869325100157952:0@lo:400:kworker.0 00000100:00100000:2.0:1782727472.811706:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869325100157568:0@lo:400:kworker.0 00010000:00080000:2.0:1782727472.811716:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3df91500 x1869325100158080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727472.811725:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100158080:0@lo:400:kworker.0 00010000:00080000:2.0:1782727472.811754:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3df93100 x1869325100157824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727472.811761:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100157824:0@lo:400:kworker.0 00000100:00100000:2.0:1782727472.811769:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325100157696:0@lo:400:kworker.0 00000100:00100000:1.0:1782727472.812001:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3445:x1869325100157440:12345-0@lo:400:kworker.0 Request processed in 3432us (6256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727472.812010:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1782727472.812349:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100157440:0@lo:400:kworker.0 00000100:00100000:3.0:1782727472.812475:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727472.812488:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100158208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727472.812537:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727472.812661:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100158208 00000100:00100000:0.0:1782727472.812667:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100158208 00000100:00100000:0.0:1782727472.812706:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782727472.812714:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100158208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727472.812745:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727472.812794:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100158208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727472.812801:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1782727472.812861:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3e004700 x1869325100158208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727472.812877:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100158208:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782727473.190523:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727474.218913:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727474.501588:0:9178:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1782727475.237583:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727476.261596:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727476.390796:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727476.390824:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100158336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727476.390912:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727476.391144:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100158336 00000100:00100000:0.0:1782727476.391153:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100158336 00000100:00100000:0.0:1782727476.391229:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782727476.391240:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100158336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727476.391278:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727476.391330:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100158336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727476.391338:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1782727476.391408:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3df90380 x1869325100158336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782727476.391507:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727476.391677:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100158336:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782727477.285721:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727477.556580:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727477.556647:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727477.556699:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080206336 00000100:00100000:0.0:1782727477.556712:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080206336 00000100:00100000:0.0:1782727477.556790:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 34 00000100:00100000:0.0:1782727477.556802:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2352:x1869325080206336:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1782727477.556911:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2352:x1869325080206336:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 110us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727477.556920:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 34 00000100:00080000:0.0:1782727477.556946:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727477.557119:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080206208 00000100:00100000:3.0:1782727477.557130:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080206208 00000100:00100000:3.0:1782727477.557166:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 191 00000100:00100000:3.0:1782727477.557173:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3436e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2352:x1869325080206208:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1782727477.557203:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3436e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2352:x1869325080206208:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 31us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727477.557211:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 191 00000100:00100000:3.0:1782727477.565367:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727477.565445:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727477.565536:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080206592 00000100:00100000:1.0:1782727477.565549:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080206592 00000100:00100000:1.0:1782727477.565619:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080206464 00000100:00100000:1.0:1782727477.565632:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080206464 00000100:00100000:1.0:1782727477.565658:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:1.0:1782727477.565670:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae035be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2353:x1869325080206592:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1782727477.565772:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae035be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2353:x1869325080206592:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 104us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727477.565781:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:1.0:1782727477.565802:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:1.0:1782727477.565808:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2353:x1869325080206464:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1782727477.565834:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2353:x1869325080206464:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 26us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727477.565841:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00080000:3.0:1782727477.565901:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782727477.565906:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727477.925613:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727477.925643:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100158464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727477.925730:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727477.925807:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100158464 00000100:00100000:0.0:1782727477.925816:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100158464 00000100:00100000:0.0:1782727477.925879:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782727477.925887:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100158464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727477.925922:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727477.925971:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100158464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727477.925978:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1782727477.926004:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782727477.926041:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3e006d80 x1869325100158464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727477.926063:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100158464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727477.926962:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325100158720:0@lo:400:kworker.0 00000100:00100000:0.0:1782727477.927013:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727477.927045:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727477.927052:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325100158848:0@lo:400:kworker.0 00000100:00100000:0.0:1782727477.927074:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727477.927103:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100158720 00000100:00100000:0.0:1782727477.927110:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100158720 00000100:00100000:0.0:1782727477.927147:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100158848 00000100:00100000:0.0:1782727477.927150:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100158848 00000100:00100000:0.0:1782727477.927174:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782727477.927181:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325100158720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727477.927226:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325100158720:12345-0@lo:400:kworker.0 Request processed in 44us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727477.927245:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782727477.927260:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782727477.927266:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325100158848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727477.927296:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325100158848:12345-0@lo:400:kworker.0 Request processed in 30us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727477.927302:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1782727477.927328:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727477.927354:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325100158848:0@lo:400:kworker.0 00000100:00100000:0.0:1782727477.927365:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325100158720:0@lo:400:kworker.0 00000100:00100000:0.0:1782727477.927415:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100158592:0@lo:400:kworker.0 00000100:00100000:0.0:1782727477.927449:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727477.927752:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1869325100159104:0@lo:400:kworker.0 00000100:00100000:0.0:1782727477.927775:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727477.927795:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727477.927801:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100158976:0@lo:400:kworker.0 00000100:00100000:0.0:1782727477.927826:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727477.927853:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100159104 00000100:00100000:0.0:1782727477.927858:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100159104 00000100:00100000:0.0:1782727477.927887:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782727477.927893:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869325100159104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727477.927927:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869325100159104:12345-0@lo:400:kworker.0 Request processed in 35us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727477.927934:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1782727477.927948:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727477.927976:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1869325100159104:0@lo:400:kworker.0 00000100:00100000:1.0:1782727477.931381:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100158976 00000100:00100000:1.0:1782727477.931407:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100158976 00000100:00100000:1.0:1782727477.931496:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782727477.931508:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100158976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727477.931746:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100158976:12345-0@lo:400:kworker.0 Request processed in 240us (3917us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727477.931754:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1782727477.931811:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3e004700 x1869325100158976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727477.931829:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100158976:0@lo:400:kworker.0 00000100:00100000:2.0:1782727477.932177:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100158592 00000100:00100000:2.0:1782727477.932183:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100158592 00000100:00100000:2.0:1782727477.932227:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1782727477.932234:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3446:x1869325100158592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727477.932281:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3446:x1869325100158592:12345-0@lo:400:kworker.0 Request processed in 48us (4832us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727477.932300:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1782727477.932346:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100158592:0@lo:400:kworker.0 00010000:00010000:1.0:1782727478.313900:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727479.285979:0:9422:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing yml_node 00010000:00010000:3.0:1782727479.340790:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727480.365749:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727481.383228:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727481.512898:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100159232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727481.513011:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727481.513430:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100159232 00000100:00100000:2.0:1782727481.513445:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100159232 00000100:00080000:0.0:1782727481.513707:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727481.514269:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782727481.514283:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100159232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727481.514316:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727481.514660:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100159232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 382us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727481.514668:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1782727481.514719:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3df91500 x1869325100159232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727481.514738:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100159232:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782727482.406300:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727482.678717:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727482.678844:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080206720 00000100:00100000:3.0:1782727482.678855:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080206720 00000100:00100000:3.0:1782727482.678922:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 193 00000100:00100000:3.0:1782727482.678933:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f581c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2352:x1869325080206720:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1782727482.679022:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f581c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2352:x1869325080206720:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 91us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727482.679031:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 193 00000100:00100000:2.0:1782727482.679525:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727482.679591:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080206848 00000100:00100000:0.0:1782727482.679596:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080206848 00000100:00100000:0.0:1782727482.679647:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 38 00000100:00100000:0.0:1782727482.679655:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2352:x1869325080206848:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1782727482.679700:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2352:x1869325080206848:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 46us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727482.679707:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 38 00000100:00080000:2.0:1782727482.680022:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727482.692892:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727482.693034:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727482.693323:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080206976 00000100:00100000:3.0:1782727482.693336:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080206976 00000100:00100000:3.0:1782727482.693456:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080207104 00000100:00100000:3.0:1782727482.693460:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080207104 00000100:00100000:3.0:1782727482.693483:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:3.0:1782727482.693494:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2349:x1869325080206976:12345-192.168.204.35@tcp:9:kworker.0 00000020:00000080:3.0:1782727482.693534:0:6941:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8db73d43f5504957 00000100:00080000:3.0:1782727482.693544:0:6941:0:(import.c:65:import_set_state_nolock()) ffff90ae3df8f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782727482.693602:0:6941:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1782727482.693769:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+2:2349:x1869325080206976:12345-192.168.204.35@tcp:9:kworker.0 Request processed in 276us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727482.693777:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:3.0:1782727482.693792:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00100000:3.0:1782727482.693799:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2349:x1869325080207104:12345-192.168.204.35@tcp:9:kworker.0 00000020:00000080:3.0:1782727482.693812:0:6941:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8db73d43f550495e 00000100:00080000:3.0:1782727482.693817:0:6941:0:(import.c:65:import_set_state_nolock()) ffff90ae3df8d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782727482.693840:0:6941:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1782727482.693904:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+2:2349:x1869325080207104:12345-192.168.204.35@tcp:9:kworker.0 Request processed in 105us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727482.693911:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 11 00010000:00010000:3.0:1782727482.693930:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727482.693937:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782727482.698308:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782727482.698320:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727483.045931:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100159360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727483.046013:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727483.046653:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100159360 00000100:00100000:0.0:1782727483.046664:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100159360 00000100:00080000:3.0:1782727483.047255:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727483.047281:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100159488:0@lo:400:kworker.0 00000100:00100000:3.0:1782727483.047346:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727483.047431:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100159488 00000100:00100000:3.0:1782727483.047436:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100159488 00000100:00100000:3.0:1782727483.047474:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1782727483.047483:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3445:x1869325100159488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727483.047536:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3445:x1869325100159488:12345-0@lo:400:kworker.0 Request processed in 54us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727483.047543:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1782727483.047590:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100159488:0@lo:400:kworker.0 00000100:00100000:3.0:1782727483.048601:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869325100159616:0@lo:400:kworker.0 00000100:00100000:1.0:1782727483.048795:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325100160000:0@lo:400:kworker.0 00000100:00100000:3.0:1782727483.048824:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727483.048858:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727483.048929:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100159872:0@lo:400:kworker.0 00000100:00100000:3.0:1782727483.048971:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727483.048996:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727483.049002:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37e3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325100159744:0@lo:400:kworker.0 00000100:00100000:3.0:1782727483.049028:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727483.049067:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100159872 00000100:00100000:3.0:1782727483.049075:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100159872 00000100:00100000:1.0:1782727483.050023:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100159616 00000100:00100000:1.0:1782727483.050035:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100159616 00000100:00100000:1.0:1782727483.050087:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100160000 00000100:00100000:1.0:1782727483.050090:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100160000 00000100:00100000:1.0:1782727483.050109:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100159744 00000100:00100000:1.0:1782727483.050112:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100159744 00000100:00100000:1.0:1782727483.050131:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782727483.050141:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869325100159616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727483.050219:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869325100159616:12345-0@lo:400:kworker.0 Request processed in 79us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727483.050227:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782727483.050244:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782727483.050251:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37e3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325100160000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727483.050322:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37e3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325100160000:12345-0@lo:400:kworker.0 Request processed in 72us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727483.050329:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782727483.050341:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782727483.050351:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325100159744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727483.050707:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325100159744:12345-0@lo:400:kworker.0 Request processed in 358us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727483.050715:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782727483.050774:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325100160000:0@lo:400:kworker.0 00000100:00100000:1.0:1782727483.050815:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869325100159616:0@lo:400:kworker.0 00000100:00100000:1.0:1782727483.050841:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37e3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325100159744:0@lo:400:kworker.0 00000100:00080000:1.0:1782727483.050908:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782727483.050913:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727483.051027:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782727483.051039:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100159360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727483.051066:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727483.051121:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100159360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (5108us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727483.051128:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1782727483.051268:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3e007480 x1869325100159360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727483.051285:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100159360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727483.051729:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782727483.051751:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100159872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727483.053679:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100159872:12345-0@lo:400:kworker.0 Request processed in 1923us (4694us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727483.053697:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1782727483.053813:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae37e3d180 x1869325100159872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727483.053834:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100159872:0@lo:400:kworker.0 00010000:00010000:3.0:1782727483.431169:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727483.785567:0:9606:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.83 00010000:00010000:3.0:1782727484.453591:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727485.481220:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782727486.172983:0:9704:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.83 00010000:00010000:3.0:1782727486.505988:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727486.630532:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100160128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727486.631275:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727486.631661:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100160128 00000100:00100000:2.0:1782727486.631670:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100160128 00000100:00100000:2.0:1782727486.631737:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782727486.631748:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100160128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727486.631782:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727486.631835:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100160128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727486.631842:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1782727486.631864:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782727486.631940:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3df90a80 x1869325100160128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727486.631961:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100160128:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782727487.525726:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727487.795251:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727487.795304:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727487.795750:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080207232 00000100:00100000:2.0:1782727487.795760:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080207232 00000100:00100000:2.0:1782727487.795819:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 195 00000100:00100000:2.0:1782727487.795831:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2350:x1869325080207232:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1782727487.795950:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2350:x1869325080207232:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 120us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727487.795959:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 195 00000100:00100000:1.0:1782727487.796057:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080207360 00000100:00100000:1.0:1782727487.796061:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080207360 00000100:00100000:1.0:1782727487.796112:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 42 00000100:00100000:1.0:1782727487.796120:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f7d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2350:x1869325080207360:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1782727487.796154:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f7d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2350:x1869325080207360:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 36us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727487.796161:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 42 00000100:00080000:2.0:1782727487.796872:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727488.165974:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0332f07-5c7b-4a87-aafc-b3671573fb48:3444:1869325100160384:0@lo:400:kworker.0 00000100:00100000:1.0:1782727488.166054:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727488.166097:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100160384 00000100:00100000:2.0:1782727488.166106:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100160384 00000100:00100000:1.0:1782727488.166111:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727488.166117:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100160256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727488.166143:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727488.166152:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1782727488.166160:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3444:x1869325100160384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727488.166216:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100160256 00000100:00100000:1.0:1782727488.166220:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100160256 00000100:00100000:2.0:1782727488.166224:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3444:x1869325100160384:12345-0@lo:400:kworker.0 Request processed in 65us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727488.166232:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1782727488.166256:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782727488.166262:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100160256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727488.166285:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727488.166316:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100160256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727488.166322:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1782727488.166340:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782727488.166399:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae37e3d180 x1869325100160256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727488.166417:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100160256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727488.166428:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0332f07-5c7b-4a87-aafc-b3671573fb48:3444:1869325100160384:0@lo:400:kworker.0 00000100:00100000:2.0:1782727488.166644:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325100160512:0@lo:400:kworker.0 00000100:00100000:2.0:1782727488.166676:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727488.166741:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782727488.166747:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325100160640:0@lo:400:kworker.0 00000100:00100000:2.0:1782727488.166879:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727488.167060:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782727488.167106:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3444:1869325100160896:0@lo:400:kworker.0 00000100:00100000:2.0:1782727488.167132:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727488.167150:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100160768:0@lo:400:kworker.0 00000100:00100000:2.0:1782727488.167173:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727488.167218:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100160768 00000100:00100000:2.0:1782727488.167222:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100160768 00000100:00100000:2.0:1782727488.167253:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782727488.167260:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100160768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727488.167298:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100160768:12345-0@lo:400:kworker.0 Request processed in 38us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727488.167310:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1782727488.167338:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae0354e680 x1869325100160768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727488.167348:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100160768:0@lo:400:kworker.0 00000100:00100000:1.0:1782727488.167616:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100160512 00000100:00100000:1.0:1782727488.167621:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100160512 00000100:00100000:1.0:1782727488.167655:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100160640 00000100:00100000:1.0:1782727488.167659:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100160640 00000100:00100000:1.0:1782727488.167673:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100160896 00000100:00100000:1.0:1782727488.167676:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100160896 00000100:00100000:1.0:1782727488.167818:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782727488.167824:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325100160512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727488.167864:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325100160512:12345-0@lo:400:kworker.0 Request processed in 40us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727488.167870:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782727488.167882:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782727488.167888:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325100160640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727488.167912:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325100160640:12345-0@lo:400:kworker.0 Request processed in 25us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727488.167924:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782727488.167936:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782727488.167941:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869325100160896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727488.167975:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869325100160896:12345-0@lo:400:kworker.0 Request processed in 34us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727488.167981:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1782727488.168012:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782727488.168016:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727488.168035:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325100160640:0@lo:400:kworker.0 00000100:00100000:1.0:1782727488.168046:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325100160512:0@lo:400:kworker.0 00000100:00100000:1.0:1782727488.168069:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3444:1869325100160896:0@lo:400:kworker.0 00000001:02000400:1.0:1782727488.237123:0:9801:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.83 00010000:00010000:3.0:1782727488.549688:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782727488.680161:0:8009:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f875d55c-258d-46bd-8e2e-5a5be22638df 00000020:00000080:0.0:1782727488.680171:0:8009:0:(genops.c:906:class_export_put()) final put ffff90ae3df8e000/f875d55c-258d-46bd-8e2e-5a5be22638df 00000020:00000080:3.0:1782727488.680256:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff90ae3df8e000/f875d55c-258d-46bd-8e2e-5a5be22638df for lustre-OST0001 00000020:00000080:3.0:1782727488.680341:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff90ae3df8d000 for lustre-OST0001 00000001:00100000:1.0:1782727488.680917:0:6933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f875d55c-258d-46bd-8e2e-5a5be22638df 00000020:00000080:1.0:1782727488.680923:0:6933:0:(genops.c:906:class_export_put()) final put ffff90ae3df8a000/f875d55c-258d-46bd-8e2e-5a5be22638df 00000020:00000080:0.0:1782727488.680996:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff90ae3df8a000/f875d55c-258d-46bd-8e2e-5a5be22638df for lustre-OST0000 00000020:00000080:0.0:1782727488.681049:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff90ae3df8f000 for lustre-OST0000 00010000:00010000:1.0:1782727489.577122:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782727489.899301:0:9849:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity ============----- Mon Jun 29 06:04:47 EDT 2026 00010000:00010000:3.0:1782727490.597646:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727491.621705:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727491.750405:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100161024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727491.750484:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727491.750567:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100161024 00000100:00100000:3.0:1782727491.750574:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100161024 00000100:00100000:3.0:1782727491.750624:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782727491.750633:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100161024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727491.750662:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727491.750704:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100161024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727491.750711:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1782727491.750730:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782727491.750759:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae0354df80 x1869325100161024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727491.750776:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100161024:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782727492.647881:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727492.911514:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727492.911566:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080207616 00000100:00100000:1.0:1782727492.911578:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080207616 00000100:00100000:1.0:1782727492.911652:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 46 00000100:00100000:1.0:1782727492.911664:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2351:x1869325080207616:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1782727492.911745:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2351:x1869325080207616:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 83us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727492.911753:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 46 00000100:00080000:3.0:1782727492.914692:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727492.919118:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727492.919289:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080207488 00000100:00100000:2.0:1782727492.919320:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080207488 00000100:00100000:2.0:1782727492.919437:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 197 00000100:00100000:2.0:1782727492.919453:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2350:x1869325080207488:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1782727492.919547:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2350:x1869325080207488:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 100us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727492.919554:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 197 00000100:00100000:0.0:1782727493.285972:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727493.285997:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100161152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727493.286172:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727493.286501:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100161280:0@lo:400:kworker.0 00000100:00100000:3.0:1782727493.286536:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727493.286564:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727493.286570:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325100161408:0@lo:400:kworker.0 00000100:00100000:3.0:1782727493.286596:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727493.286596:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100161664:0@lo:400:kworker.0 00000100:00100000:3.0:1782727493.286613:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325100161792:0@lo:400:kworker.0 00000100:00100000:2.0:1782727493.286626:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727493.286630:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727493.286645:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727493.286651:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3446:1869325100161536:0@lo:400:kworker.0 00000100:00100000:3.0:1782727493.286657:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100161280 00000100:00100000:3.0:1782727493.286664:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100161280 00000100:00100000:3.0:1782727493.286716:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1782727493.286725:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100161280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727493.286746:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727493.286782:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100161664 00000100:00100000:2.0:1782727493.286785:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100161664 00000100:00100000:3.0:1782727493.286791:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100161280:12345-0@lo:400:kworker.0 Request processed in 67us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727493.286798:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1782727493.286817:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782727493.286823:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100161664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727493.286828:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100161408 00000100:00100000:3.0:1782727493.286831:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100161408 00000100:00100000:3.0:1782727493.286852:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100161792 00000100:00100000:3.0:1782727493.286855:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100161792 00000100:00100000:2.0:1782727493.286856:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100161664:12345-0@lo:400:kworker.0 Request processed in 34us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727493.286862:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782727493.286867:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100161536 00000100:00100000:3.0:1782727493.286869:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100161536 00000100:00100000:3.0:1782727493.286881:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782727493.286886:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325100161408:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1782727493.286896:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3df91c00 x1869325100161664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727493.286913:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325100161408:12345-0@lo:400:kworker.0 Request processed in 27us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727493.286918:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782727493.286922:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100161664:0@lo:400:kworker.0 00000100:00100000:3.0:1782727493.286928:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782727493.286932:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325100161792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727493.286955:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325100161792:12345-0@lo:400:kworker.0 Request processed in 23us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727493.286961:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782727493.286964:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325100161792:0@lo:400:kworker.0 00000100:00100000:3.0:1782727493.286970:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782727493.286973:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325100161408:0@lo:400:kworker.0 00000100:00100000:3.0:1782727493.286975:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869325100161536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727493.286980:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100161280:0@lo:400:kworker.0 00000100:00080000:2.0:1782727493.287002:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727493.287004:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869325100161536:12345-0@lo:400:kworker.0 Request processed in 29us (257us total) trans 0 rc 0/0 00000100:00080000:2.0:1782727493.287006:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727493.287010:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782727493.287030:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3446:1869325100161536:0@lo:400:kworker.0 00000100:00100000:1.0:1782727493.287165:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100161152 00000100:00100000:1.0:1782727493.287170:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100161152 00000100:00100000:1.0:1782727493.287211:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782727493.287226:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100161152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727493.287249:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727493.287284:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100161152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727493.287291:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1782727493.287453:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782727493.287595:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae37e3d180 x1869325100161152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727493.287611:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100161152:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782727493.670708:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727494.697139:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727495.724354:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727496.746524:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727496.870712:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727496.870737:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100161920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727496.870808:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727496.870869:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100161920 00000100:00100000:2.0:1782727496.870876:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100161920 00000100:00100000:2.0:1782727496.870925:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782727496.870933:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100161920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727496.870960:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727496.870999:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100161920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727496.871006:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1782727496.871038:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727496.871067:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae0354ca80 x1869325100161920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727496.871115:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100161920:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782727497.766453:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727498.035134:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727498.035220:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727498.035342:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080207872 00000100:00100000:2.0:1782727498.035357:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080207872 00000100:00100000:2.0:1782727498.035481:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 50 00000100:00100000:2.0:1782727498.035494:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2352:x1869325080207872:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1782727498.035592:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2352:x1869325080207872:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 101us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727498.035599:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 50 00000100:00100000:0.0:1782727498.035685:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080207744 00000100:00100000:0.0:1782727498.035690:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080207744 00000100:00100000:0.0:1782727498.035736:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 199 00000100:00100000:0.0:1782727498.035745:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2352:x1869325080207744:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1782727498.035775:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2352:x1869325080207744:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 32us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727498.035782:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 199 00000100:00080000:3.0:1782727498.036348:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727498.405605:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b0eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100162048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727498.405709:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727498.405814:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100162048 00000100:00100000:2.0:1782727498.405824:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100162048 00000100:00100000:2.0:1782727498.405894:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782727498.405906:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100162048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727498.405946:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727498.406010:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100162048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727498.406019:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1782727498.406045:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782727498.406085:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b0eea00 x1869325100162048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727498.406106:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b0eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100162048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727498.408858:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325100162304:0@lo:400:kworker.0 00000100:00100000:2.0:1782727498.408950:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727498.409030:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727498.409038:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b39f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325100162432:0@lo:400:kworker.0 00000100:00100000:2.0:1782727498.409064:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727498.409108:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100162304 00000100:00100000:2.0:1782727498.409117:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100162304 00000100:00100000:2.0:1782727498.409169:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100162432 00000100:00100000:2.0:1782727498.409173:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100162432 00000100:00100000:2.0:1782727498.409208:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782727498.409217:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325100162304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727498.409298:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325100162304:12345-0@lo:400:kworker.0 Request processed in 81us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727498.409307:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782727498.409327:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782727498.409333:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325100162432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727498.409368:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325100162432:12345-0@lo:400:kworker.0 Request processed in 35us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727498.409618:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782727498.409650:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100162176:0@lo:400:kworker.0 00000100:00100000:2.0:1782727498.409685:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727498.409726:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b39d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1869325100162688:0@lo:400:kworker.0 00000100:00100000:2.0:1782727498.409749:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727498.409768:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727498.409775:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b39ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100162560:0@lo:400:kworker.0 00000100:00100000:2.0:1782727498.409802:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782727498.409829:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727498.409866:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b39f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325100162432:0@lo:400:kworker.0 00000100:00100000:2.0:1782727498.409891:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325100162304:0@lo:400:kworker.0 00000100:00100000:2.0:1782727498.409933:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100162688 00000100:00100000:2.0:1782727498.409938:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100162688 00000100:00100000:2.0:1782727498.409967:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782727498.409974:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869325100162688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727498.410022:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869325100162688:12345-0@lo:400:kworker.0 Request processed in 49us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727498.410029:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1782727498.410045:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727498.410061:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b39d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1869325100162688:0@lo:400:kworker.0 00000100:00100000:1.0:1782727498.414270:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100162176 00000100:00100000:1.0:1782727498.414294:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100162176 00000100:00100000:1.0:1782727498.414398:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1782727498.414412:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3446:x1869325100162176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727498.414548:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3446:x1869325100162176:12345-0@lo:400:kworker.0 Request processed in 138us (4861us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727498.414557:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1782727498.414615:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100162560 00000100:00100000:1.0:1782727498.414620:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100162560 00000100:00100000:1.0:1782727498.414668:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782727498.414675:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100162560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727498.414716:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100162560:12345-0@lo:400:kworker.0 Request processed in 42us (4912us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727498.414724:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1782727498.414745:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727498.414951:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b39ca80 x1869325100162560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727498.414972:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b39ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100162560:0@lo:400:kworker.0 00000100:00100000:2.0:1782727498.414986:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100162176:0@lo:400:kworker.0 00010000:00010000:3.0:1782727498.789637:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727499.817648:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727500.842766:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727501.861575:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727501.990079:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782727501.991028:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100162816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727501.991137:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727501.992002:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100162816 00000100:00100000:2.0:1782727501.992016:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100162816 00000100:00100000:2.0:1782727501.992092:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782727501.992884:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100162816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727501.993021:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727501.993124:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100162816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1021us (1984us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727501.993147:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1782727501.994609:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727501.994680:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae0354d880 x1869325100162816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727501.994711:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100162816:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782727502.886868:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727503.153099:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727503.153156:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727503.153293:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080208000 00000100:00100000:3.0:1782727503.153303:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080208000 00000100:00100000:3.0:1782727503.153364:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 201 00000100:00100000:3.0:1782727503.153404:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2351:x1869325080208000:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1782727503.153495:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2351:x1869325080208000:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 122us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727503.153503:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 201 00000100:00100000:2.0:1782727503.154189:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080208128 00000100:00100000:2.0:1782727503.154198:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080208128 00000100:00100000:2.0:1782727503.154261:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 54 00000100:00100000:2.0:1782727503.154270:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2351:x1869325080208128:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1782727503.154321:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2351:x1869325080208128:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 53us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727503.154328:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 54 00000100:00080000:3.0:1782727503.155068:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727503.525719:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100162944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727503.525827:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727503.526210:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100162944 00000100:00100000:2.0:1782727503.526220:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100162944 00000100:00100000:2.0:1782727503.526283:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782727503.526293:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100162944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727503.526324:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727503.526367:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100162944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727503.526400:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1782727503.526553:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae0354d880 x1869325100162944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727503.526574:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100162944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727503.527569:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100163456:0@lo:400:kworker.0 00000100:00100000:2.0:1782727503.527634:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727503.527701:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae0354d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100163072:0@lo:400:kworker.0 00000100:00100000:3.0:1782727503.527736:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727503.527806:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869325100163200:0@lo:400:kworker.0 00000100:00100000:0.0:1782727503.527837:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782727503.531464:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782727503.531528:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100163200 00000100:00100000:1.0:1782727503.531540:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100163200 00000100:00100000:1.0:1782727503.531647:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782727503.531656:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869325100163200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727503.531770:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869325100163200:12345-0@lo:400:kworker.0 Request processed in 100us (3916us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727503.531778:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782727503.531820:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100163072 00000100:00100000:1.0:1782727503.531824:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100163072 00000100:00100000:1.0:1782727503.531852:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1782727503.531858:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3445:x1869325100163072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727503.531914:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3445:x1869325100163072:12345-0@lo:400:kworker.0 Request processed in 55us (4177us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727503.531921:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1782727503.531962:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325100163328:0@lo:400:kworker.0 00000100:00100000:1.0:1782727503.531995:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727503.536113:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100163456 00000100:00100000:3.0:1782727503.536132:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100163456 00000100:00100000:3.0:1782727503.536219:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727503.536230:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e14d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100163456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727503.536455:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100163328 00000100:00100000:2.0:1782727503.536485:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100163328 00000100:00100000:2.0:1782727503.536550:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782727503.536575:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325100163328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727503.536631:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325100163328:12345-0@lo:400:kworker.0 Request processed in 58us (4635us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727503.536638:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1782727503.536830:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782727503.536835:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727503.536887:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae0354d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100163072:0@lo:400:kworker.0 00000100:00100000:2.0:1782727503.536907:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325100163584:0@lo:400:kworker.0 00000100:00100000:2.0:1782727503.536945:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727503.537006:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100163584 00000100:00100000:2.0:1782727503.537009:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100163584 00000100:00100000:2.0:1782727503.537036:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782727503.537042:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e14ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325100163584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727503.537077:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e14ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325100163584:12345-0@lo:400:kworker.0 Request processed in 34us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727503.537083:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1782727503.537095:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727503.537114:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325100163584:0@lo:400:kworker.0 00000100:00100000:3.0:1782727503.537508:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e14d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100163456:12345-0@lo:400:kworker.0 Request processed in 1280us (9873us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727503.537516:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782727503.537694:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869325100163200:0@lo:400:kworker.0 00000100:00100000:1.0:1782727503.538577:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325100163328:0@lo:400:kworker.0 00010000:00080000:2.0:1782727503.539144:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3e14f480 x1869325100163456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727503.539158:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100163456:0@lo:400:kworker.0 00010000:00010000:0.0:1782727503.910911:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727504.933835:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727505.958967:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727506.981733:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727507.113725:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100163712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727507.113807:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727507.113914:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100163712 00000100:00100000:0.0:1782727507.113989:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100163712 00000100:00100000:0.0:1782727507.114062:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782727507.114073:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100163712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727507.114104:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727507.114148:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100163712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727507.114155:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1782727507.114177:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782727507.114210:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3e004380 x1869325100163712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727507.114231:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100163712:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1782727507.725687:0:10577:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34682451 <= 34618625) for LU-18938, skip 360 00010000:00010000:0.0:1782727508.006404:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727508.273745:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727508.273809:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727508.273901:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080208384 00000100:00100000:3.0:1782727508.273911:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080208384 00000100:00100000:3.0:1782727508.273985:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 58 00000100:00100000:3.0:1782727508.273997:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2352:x1869325080208384:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1782727508.274103:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2352:x1869325080208384:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 109us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727508.274111:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 58 00000100:00080000:0.0:1782727508.274309:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727508.274952:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080208256 00000100:00100000:2.0:1782727508.274959:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080208256 00000100:00100000:2.0:1782727508.275008:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 203 00000100:00100000:2.0:1782727508.275016:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2352:x1869325080208256:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1782727508.275151:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2352:x1869325080208256:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 135us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727508.275159:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 203 00000100:00100000:3.0:1782727508.645781:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100163840:0@lo:400:kworker.0 00000100:00100000:3.0:1782727508.645868:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727508.645930:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325100164352:0@lo:400:kworker.0 00000100:00100000:3.0:1782727508.645959:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727508.646390:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100163840 00000100:00100000:2.0:1782727508.646400:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100163840 00000100:00100000:2.0:1782727508.646455:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1782727508.646466:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100163840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727508.646535:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100163840:12345-0@lo:400:kworker.0 Request processed in 70us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727508.646542:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1782727508.646579:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100164352 00000100:00100000:2.0:1782727508.646583:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100164352 00000100:00100000:2.0:1782727508.646620:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782727508.646627:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b39c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325100164352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727508.646659:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b39c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325100164352:12345-0@lo:400:kworker.0 Request processed in 33us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727508.646666:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782727508.647008:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325100163968:0@lo:400:kworker.0 00000100:00100000:0.0:1782727508.647041:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727508.647067:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100164480:0@lo:400:kworker.0 00000100:00100000:0.0:1782727508.647090:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727508.647125:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325100164096:0@lo:400:kworker.0 00000100:00100000:0.0:1782727508.647150:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727508.647589:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727508.647599:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100164224:0@lo:400:kworker.0 00000100:00100000:0.0:1782727508.647647:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782727508.647678:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727508.647725:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100163968 00000100:00100000:0.0:1782727508.647730:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100163968 00000100:00100000:0.0:1782727508.649445:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100164096 00000100:00100000:0.0:1782727508.649460:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100164096 00000100:00100000:0.0:1782727508.649537:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782727508.649547:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325100163968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727508.649640:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325100163968:12345-0@lo:400:kworker.0 Request processed in 94us (2597us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727508.649648:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782727508.649668:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782727508.649674:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325100164096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727508.649703:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325100164096:12345-0@lo:400:kworker.0 Request processed in 29us (2551us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727508.649708:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782727508.649753:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100164480 00000100:00100000:0.0:1782727508.649758:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100164480 00000100:00100000:0.0:1782727508.649807:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100164224 00000100:00100000:0.0:1782727508.649811:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100164224 00000100:00100000:0.0:1782727508.649829:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782727508.649833:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100164480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727508.649868:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100164480:12345-0@lo:400:kworker.0 Request processed in 35us (2777us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727508.649874:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782727508.649884:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782727508.649890:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100164224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727508.649917:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100164224:12345-0@lo:400:kworker.0 Request processed in 27us (2269us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727508.649922:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782727508.649949:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727508.649966:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b39c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100164608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727508.650021:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727508.650052:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100164608 00000100:00100000:0.0:1782727508.650055:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100164608 00000100:00100000:0.0:1782727508.650081:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782727508.650088:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100164608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727508.650112:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727508.650148:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100164608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727508.650154:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782727508.650241:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325100163968:0@lo:400:kworker.0 00010000:00080000:0.0:1782727508.650258:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3e14d500 x1869325100164480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727508.650563:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325100164352:0@lo:400:kworker.0 00000100:00100000:2.0:1782727508.650589:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100163840:0@lo:400:kworker.0 00010000:00080000:2.0:1782727508.650643:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3e14f100 x1869325100164224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727508.650655:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100164224:0@lo:400:kworker.0 00000100:00100000:2.0:1782727508.650665:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325100164096:0@lo:400:kworker.0 00010000:00080000:2.0:1782727508.650724:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b39c700 x1869325100164608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727508.650746:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b39c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100164608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727508.651161:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100164480:0@lo:400:kworker.0 00000100:00080000:3.0:1782727508.651234:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782727508.651240:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782727509.030704:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782727509.500100:0:10625:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34682451 < 34486116) for LU-14927, skip 0f 00010000:00010000:0.0:1782727510.054842:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782727511.070809:0:10673:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need OST1_VERSION < v2_17_50-410-gbd8e7b9555 (34682451 < 34681754) for LU-12550, skip 216 00010000:00010000:0.0:1782727511.077765:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727512.109806:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727512.231853:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727512.231878:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dfc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100164736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727512.232108:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727512.232185:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100164736 00000100:00100000:0.0:1782727512.232193:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100164736 00000100:00100000:0.0:1782727512.232251:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782727512.232260:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100164736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727512.232293:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727512.232354:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100164736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727512.232361:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1782727512.232429:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3dfc5880 x1869325100164736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727512.232448:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dfc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100164736:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782727512.232824:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1782727513.001115:0:10722:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 42a 42c 42b 118c 118d 407 119i 216 817 411a 00010000:00010000:0.0:1782727513.125672:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727513.392224:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727513.393722:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080208512 00000100:00100000:0.0:1782727513.393740:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080208512 00000100:00100000:0.0:1782727513.393827:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 205 00000100:00100000:0.0:1782727513.393837:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2352:x1869325080208512:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1782727513.393925:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2352:x1869325080208512:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 91us (1714us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727513.393933:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 205 00000100:00100000:1.0:1782727513.394056:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727513.394272:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080208640 00000100:00100000:0.0:1782727513.394282:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080208640 00000100:00080000:3.0:1782727513.394347:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727513.394448:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:0.0:1782727513.394461:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2352:x1869325080208640:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1782727513.394652:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2352:x1869325080208640:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 193us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727513.394661:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:0.0:1782727513.766263:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325100164992:0@lo:400:kworker.0 00000100:00100000:0.0:1782727513.766366:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727513.766477:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100165504:0@lo:400:kworker.0 00000100:00100000:0.0:1782727513.766508:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727513.766557:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782727513.766564:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0332f07-5c7b-4a87-aafc-b3671573fb48:3444:1869325100164864:0@lo:400:kworker.0 00000100:00100000:0.0:1782727513.766596:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727513.766622:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3444:1869325100165376:0@lo:400:kworker.0 00000100:00100000:0.0:1782727513.766646:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727513.766674:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325100165120:0@lo:400:kworker.0 00000100:00100000:0.0:1782727513.766710:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727513.766726:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b39ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100165632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727513.766754:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727513.766776:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727513.766781:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100165248:0@lo:400:kworker.0 00000100:00100000:3.0:1782727513.766893:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100164992 00000100:00100000:3.0:1782727513.766904:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100164992 00000100:00100000:3.0:1782727513.766963:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100165376 00000100:00100000:3.0:1782727513.766967:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100165376 00000100:00100000:3.0:1782727513.767051:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100165120 00000100:00100000:3.0:1782727513.767055:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100165120 00000100:00100000:3.0:1782727513.767085:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782727513.767095:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325100164992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727513.767167:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1869325100164992:12345-0@lo:400:kworker.0 Request processed in 73us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727513.767175:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782727513.767196:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782727513.767203:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869325100165376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727513.767251:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869325100165376:12345-0@lo:400:kworker.0 Request processed in 50us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727513.767258:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782727513.767268:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782727513.767274:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325100165120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727513.767301:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325100165120:12345-0@lo:400:kworker.0 Request processed in 27us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727513.767307:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1782727513.767326:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727513.767366:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100164864 00000100:00100000:3.0:1782727513.767397:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100164864 00000100:00100000:3.0:1782727513.767429:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1782727513.767434:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3444:x1869325100164864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727513.767464:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3444:x1869325100164864:12345-0@lo:400:kworker.0 Request processed in 29us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727513.767469:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1782727513.767498:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100165504 00000100:00100000:3.0:1782727513.767503:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100165504 00000100:00100000:3.0:1782727513.767534:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782727513.767540:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100165504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727513.767571:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100165504:12345-0@lo:400:kworker.0 Request processed in 31us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727513.767577:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1782727513.767590:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727513.767611:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100165632 00000100:00100000:3.0:1782727513.767615:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100165632 00000100:00100000:3.0:1782727513.767638:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782727513.767653:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100165632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727513.767680:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727513.767724:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100165632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727513.767731:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782727513.767775:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0332f07-5c7b-4a87-aafc-b3671573fb48:3444:1869325100164864:0@lo:400:kworker.0 00000100:00100000:3.0:1782727513.767808:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3444:1869325100165376:0@lo:400:kworker.0 00000100:00100000:0.0:1782727513.768610:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727513.768659:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325100165120:0@lo:400:kworker.0 00010000:00080000:0.0:1782727513.768678:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b39ce00 x1869325100165632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727513.768719:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b39ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100165632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727513.769117:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100165248 00000100:00100000:1.0:1782727513.769125:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100165248 00000100:00100000:1.0:1782727513.769177:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782727513.769185:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100165248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727513.769250:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100165248:12345-0@lo:400:kworker.0 Request processed in 65us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727513.769266:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1782727513.770232:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3e14ca80 x1869325100165248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727513.770249:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100165248:0@lo:400:kworker.0 00000100:00100000:3.0:1782727513.770401:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1869325100164992:0@lo:400:kworker.0 00010000:00080000:3.0:1782727513.770418:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3e14c700 x1869325100165504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727513.770429:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100165504:0@lo:400:kworker.0 00010000:00010000:0.0:1782727514.153405:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782727514.794976:0:10770:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51c 51e 834 00010000:00010000:3.0:1782727515.174339:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727516.203077:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727516.430738:0:10818:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: start setup 06:05:14 (1782727514) === 00010000:00010000:0.0:1782727517.222566:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727517.350191:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727517.350216:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dfc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100165760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727517.350288:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727517.351027:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100165760 00000100:00100000:3.0:1782727517.351037:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100165760 00000100:00100000:3.0:1782727517.351100:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782727517.351112:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100165760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727517.351144:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727517.351201:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100165760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727517.351208:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1782727517.351271:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782727517.351351:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3dfc4700 x1869325100165760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727517.351407:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dfc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100165760:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782727518.253766:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727518.508173:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727518.508227:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727518.508294:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080208768 00000100:00100000:0.0:1782727518.508305:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080208768 00000100:00100000:0.0:1782727518.508395:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 207 00000100:00100000:0.0:1782727518.508416:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2353:x1869325080208768:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1782727518.508492:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2353:x1869325080208768:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 78us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727518.508499:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 207 00000100:00100000:3.0:1782727518.508651:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080208896 00000100:00100000:3.0:1782727518.508656:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080208896 00000100:00100000:3.0:1782727518.508718:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:3.0:1782727518.508728:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e14ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2353:x1869325080208896:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1782727518.508778:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e14ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2353:x1869325080208896:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 52us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727518.508786:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00080000:0.0:1782727518.509523:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727518.888969:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37e3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100165888:0@lo:400:kworker.0 00000100:00100000:1.0:1782727518.889049:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727518.889112:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325100166400:0@lo:400:kworker.0 00000100:00100000:1.0:1782727518.889139:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727518.889164:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782727518.889169:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37e3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325100166016:0@lo:400:kworker.0 00000100:00100000:1.0:1782727518.889189:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727518.889204:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100166528:0@lo:400:kworker.0 00000100:00100000:1.0:1782727518.889229:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727518.889257:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37e3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325100166144:0@lo:400:kworker.0 00000100:00100000:1.0:1782727518.889279:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727518.889296:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727518.889301:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37e3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100166272:0@lo:400:kworker.0 00000100:00100000:1.0:1782727518.889321:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727518.889350:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100165888 00000100:00100000:1.0:1782727518.889358:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100165888 00000100:00100000:1.0:1782727518.889425:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1782727518.889433:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100165888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727518.889478:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100165888:12345-0@lo:400:kworker.0 Request processed in 46us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727518.889485:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1782727518.889515:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100166400 00000100:00100000:1.0:1782727518.889518:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100166400 00000100:00100000:1.0:1782727518.889562:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100166016 00000100:00100000:1.0:1782727518.889565:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100166016 00000100:00100000:1.0:1782727518.889575:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100166144 00000100:00100000:1.0:1782727518.889578:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100166144 00000100:00100000:1.0:1782727518.889602:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782727518.889609:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37e3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325100166400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727518.889640:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37e3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325100166400:12345-0@lo:400:kworker.0 Request processed in 33us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727518.889647:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782727518.889657:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782727518.889662:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37e3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325100166016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727518.889684:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37e3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325100166016:12345-0@lo:400:kworker.0 Request processed in 22us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727518.889689:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782727518.889698:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782727518.889703:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325100166144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727518.889729:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325100166144:12345-0@lo:400:kworker.0 Request processed in 26us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727518.889735:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782727518.889752:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100166528 00000100:00100000:1.0:1782727518.889756:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100166528 00000100:00100000:1.0:1782727518.889776:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100166272 00000100:00100000:1.0:1782727518.889779:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100166272 00000100:00100000:1.0:1782727518.889789:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782727518.889794:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100166528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727518.889819:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100166528:12345-0@lo:400:kworker.0 Request processed in 25us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727518.889834:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782727518.889844:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782727518.889849:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100166272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727518.889874:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100166272:12345-0@lo:400:kworker.0 Request processed in 25us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727518.889879:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1782727518.889901:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727518.889905:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782727518.889936:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae37e3f100 x1869325100166272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727518.889950:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37e3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100166272:0@lo:400:kworker.0 00000100:00100000:1.0:1782727518.889960:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37e3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325100166144:0@lo:400:kworker.0 00000100:00100000:1.0:1782727518.889984:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37e3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325100166016:0@lo:400:kworker.0 00010000:00080000:1.0:1782727518.889993:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae37e3d500 x1869325100166528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727518.890002:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100166528:0@lo:400:kworker.0 00000100:00100000:1.0:1782727518.890009:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37e3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100165888:0@lo:400:kworker.0 00000100:00100000:1.0:1782727518.890017:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325100166400:0@lo:400:kworker.0 00000100:00100000:0.0:1782727518.890654:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b39ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100166656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727518.890691:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727518.890778:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100166656 00000100:00100000:3.0:1782727518.890784:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100166656 00000100:00100000:3.0:1782727518.890820:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782727518.890827:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100166656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727518.890848:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727518.890885:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100166656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727518.890891:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1782727518.891003:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b39ed80 x1869325100166656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727518.891031:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b39ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100166656:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782727519.278180:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727520.301963:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727521.318918:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727522.343602:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727522.479935:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782727522.479958:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100166784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727522.480026:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727522.480082:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100166784 00000100:00100000:2.0:1782727522.480089:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100166784 00000100:00080000:1.0:1782727522.480122:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727522.480139:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782727522.480153:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e14e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100166784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727522.480180:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727522.480221:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e14e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100166784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (194us total) trans 0 rc 0/0 00010000:00080000:1.0:1782727522.486013:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3e14ed80 x1869325100166784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727522.486066:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100166784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727522.491493:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000001:02000400:1.0:1782727522.948009:0:11011:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1782727523.365627:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727523.628665:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727523.628722:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727523.628778:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080209152 00000100:00100000:1.0:1782727523.628787:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080209152 00000100:00080000:3.0:1782727523.628951:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727523.629011:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080209024 00000100:00100000:2.0:1782727523.629016:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080209024 00000100:00100000:2.0:1782727523.629067:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 209 00000100:00100000:2.0:1782727523.629084:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2353:x1869325080209024:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1782727523.629156:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2353:x1869325080209024:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 81us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727523.629163:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 209 00000100:00100000:1.0:1782727523.629780:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:1.0:1782727523.629790:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b39e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2353:x1869325080209152:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1782727523.629838:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b39e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2353:x1869325080209152:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 52us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727523.629846:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:0.0:1782727524.005618:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b39fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100166912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727524.005699:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727524.005816:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100166912 00000100:00100000:3.0:1782727524.005823:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100166912 00000100:00100000:3.0:1782727524.005888:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782727524.005898:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100166912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727524.005927:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727524.005971:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100166912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727524.005979:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1782727524.006024:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b39fb80 x1869325100166912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727524.006041:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b39fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100166912:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782727524.006181:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727524.017420:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100167424:0@lo:400:kworker.0 00000100:00100000:0.0:1782727524.017505:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727524.017550:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782727524.017555:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100167040:0@lo:400:kworker.0 00000100:00100000:0.0:1782727524.017580:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727524.017596:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325100167552:0@lo:400:kworker.0 00000100:00100000:0.0:1782727524.017615:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727524.018120:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325100167168:0@lo:400:kworker.0 00000100:00100000:1.0:1782727524.018150:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727524.018178:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727524.018183:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325100167296:0@lo:400:kworker.0 00000100:00100000:1.0:1782727524.018201:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727524.018230:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100167424 00000100:00100000:1.0:1782727524.018236:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100167424 00000100:00100000:1.0:1782727524.018283:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782727524.018291:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100167424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727524.018354:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100167424:12345-0@lo:400:kworker.0 Request processed in 63us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727524.018361:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782727524.018409:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100167040 00000100:00100000:1.0:1782727524.018412:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100167040 00000100:00100000:1.0:1782727524.018435:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1782727524.018441:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100167040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727524.018478:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100167040:12345-0@lo:400:kworker.0 Request processed in 37us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727524.018484:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1782727524.018520:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100167552 00000100:00100000:1.0:1782727524.018524:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100167552 00000100:00100000:1.0:1782727524.018545:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100167168 00000100:00100000:1.0:1782727524.018547:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100167168 00000100:00100000:1.0:1782727524.018556:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100167296 00000100:00100000:1.0:1782727524.018558:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100167296 00000100:00100000:1.0:1782727524.018570:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782727524.018575:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325100167552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727524.018601:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325100167552:12345-0@lo:400:kworker.0 Request processed in 26us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727524.018607:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782727524.018616:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782727524.018620:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325100167168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727524.018643:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325100167168:12345-0@lo:400:kworker.0 Request processed in 23us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727524.018649:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782727524.018658:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782727524.018663:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37e3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325100167296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727524.018682:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37e3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325100167296:12345-0@lo:400:kworker.0 Request processed in 20us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727524.018688:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782727524.018727:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325100167296:0@lo:400:kworker.0 00000100:00100000:1.0:1782727524.018736:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325100167168:0@lo:400:kworker.0 00000100:00080000:1.0:1782727524.018765:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782727524.018769:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727524.018782:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100167040:0@lo:400:kworker.0 00000100:00100000:1.0:1782727524.018792:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325100167552:0@lo:400:kworker.0 00010000:00080000:1.0:1782727524.018804:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3e14ed80 x1869325100167424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727524.018814:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100167424:0@lo:400:kworker.0 00010000:00010000:1.0:1782727524.390863:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727525.414042:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727526.438471:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727527.467723:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727527.590874:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100167680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727527.590956:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727527.591214:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100167680 00000100:00100000:2.0:1782727527.591236:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100167680 00000100:00100000:2.0:1782727527.591311:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782727527.591321:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100167680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727527.591352:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727527.591449:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100167680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727527.591457:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1782727527.591593:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727527.591735:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3e14f100 x1869325100167680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727527.591755:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100167680:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782727528.486696:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727528.749520:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727528.749589:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727528.749700:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080209408 00000100:00100000:0.0:1782727528.749715:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080209408 00000100:00100000:0.0:1782727528.749809:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 74 00000100:00100000:0.0:1782727528.749822:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b39fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2351:x1869325080209408:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1782727528.749923:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b39fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2351:x1869325080209408:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 103us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727528.749945:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 74 00000100:00100000:2.0:1782727528.750297:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080209280 00000100:00100000:2.0:1782727528.750302:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080209280 00000100:00100000:2.0:1782727528.750347:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 211 00000100:00100000:2.0:1782727528.750356:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2351:x1869325080209280:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1782727528.750428:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2351:x1869325080209280:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 74us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727528.750435:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 211 00000100:00080000:3.0:1782727528.750550:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727529.125940:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727529.125966:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b39df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100167808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727529.126039:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727529.126113:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100167808 00000100:00100000:3.0:1782727529.126121:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100167808 00000100:00100000:3.0:1782727529.126177:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782727529.126188:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b39d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100167808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727529.126219:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727529.126258:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b39d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100167808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727529.126266:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1782727529.126284:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782727529.126313:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b39df80 x1869325100167808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727529.126332:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b39df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100167808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727529.128736:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100167936:0@lo:400:kworker.0 00000100:00100000:3.0:1782727529.128808:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727529.128859:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727529.128867:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325100168064:0@lo:400:kworker.0 00000100:00100000:3.0:1782727529.128893:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727529.128921:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100167936 00000100:00100000:3.0:1782727529.128936:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100167936 00000100:00100000:3.0:1782727529.128980:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1782727529.128990:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100167936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727529.129041:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100167936:12345-0@lo:400:kworker.0 Request processed in 53us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727529.129048:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1782727529.129079:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100168064 00000100:00100000:3.0:1782727529.129083:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100168064 00000100:00100000:3.0:1782727529.129110:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782727529.129116:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b39df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325100168064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727529.129146:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b39df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325100168064:12345-0@lo:400:kworker.0 Request processed in 30us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727529.129152:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782727529.129190:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325100168064:0@lo:400:kworker.0 00000100:00100000:3.0:1782727529.129200:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100167936:0@lo:400:kworker.0 00000100:00100000:2.0:1782727529.129898:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100168320:0@lo:400:kworker.0 00000100:00100000:2.0:1782727529.129977:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727529.130022:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727529.130029:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3446:1869325100168192:0@lo:400:kworker.0 00000100:00100000:2.0:1782727529.130059:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727529.130104:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100168320 00000100:00100000:2.0:1782727529.130114:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100168320 00000100:00100000:2.0:1782727529.130204:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782727529.130215:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e14d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100168320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727529.130311:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e14d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100168320:12345-0@lo:400:kworker.0 Request processed in 97us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727529.130320:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782727529.130349:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100168192 00000100:00100000:2.0:1782727529.130354:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100168192 00000100:00100000:2.0:1782727529.130422:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782727529.130432:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e14dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869325100168192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727529.130477:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325100168448:0@lo:400:kworker.0 00000100:00100000:2.0:1782727529.130478:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e14dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869325100168192:12345-0@lo:400:kworker.0 Request processed in 45us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727529.130488:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1782727529.130518:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782727529.130527:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727529.130559:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727529.130572:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3446:1869325100168192:0@lo:400:kworker.0 00010000:00080000:2.0:1782727529.130596:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3e14ca80 x1869325100168320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727529.130609:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100168320:0@lo:400:kworker.0 00000100:00100000:3.0:1782727529.130640:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100168448 00000100:00100000:3.0:1782727529.130648:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100168448 00000100:00100000:3.0:1782727529.130719:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782727529.130728:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b39f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325100168448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727529.130774:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b39f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325100168448:12345-0@lo:400:kworker.0 Request processed in 48us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727529.130781:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782727529.130821:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325100168448:0@lo:400:kworker.0 00000100:00080000:2.0:1782727529.132216:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782727529.524330:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727530.533717:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782727531.213052:0:11273:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782727531.213282:0:11273:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782727531.557676:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727532.581923:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727532.713692:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727532.713717:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dfc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100168576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727532.713802:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727532.714787:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100168576 00000100:00100000:0.0:1782727532.714798:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100168576 00000100:00080000:2.0:1782727532.715125:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727532.715306:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782727532.715328:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100168576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727532.715365:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727532.715476:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100168576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727532.715483:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1782727532.725006:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3dfc5f80 x1869325100168576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727532.725034:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dfc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100168576:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782727533.606917:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727533.869881:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727533.869933:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727533.870059:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080209536 00000100:00100000:0.0:1782727533.870069:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080209536 00000100:00100000:0.0:1782727533.870124:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 213 00000100:00100000:0.0:1782727533.870133:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2350:x1869325080209536:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1782727533.870203:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2350:x1869325080209536:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 71us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727533.870210:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 213 00000100:00100000:2.0:1782727533.870644:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080209664 00000100:00100000:2.0:1782727533.870650:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080209664 00000100:00100000:2.0:1782727533.870702:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 78 00000100:00100000:2.0:1782727533.870709:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2351:x1869325080209664:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1782727533.870748:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2351:x1869325080209664:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 39us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727533.870769:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 78 00000100:00080000:0.0:1782727533.871197:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000004:3.0:1782727533.872363:0:11371:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782727533.874021:0:11371:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1782727534.250678:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727534.250704:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b39e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100168704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727534.250774:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727534.250838:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100168704 00000100:00100000:2.0:1782727534.250845:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100168704 00000100:00100000:2.0:1782727534.250893:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782727534.250902:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e14ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100168704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727534.250934:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727534.250974:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e14ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100168704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727534.250981:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1782727534.251000:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782727534.251031:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b39e300 x1869325100168704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727534.251049:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b39e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100168704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727534.251300:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37e3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325100168960:0@lo:400:kworker.0 00000100:00100000:1.0:1782727534.251329:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727534.251350:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782727534.251355:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325100169088:0@lo:400:kworker.0 00000100:00100000:1.0:1782727534.251393:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727534.251415:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100168960 00000100:00100000:1.0:1782727534.251424:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100168960 00000100:00100000:1.0:1782727534.251448:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100169088 00000100:00100000:1.0:1782727534.251450:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100169088 00000100:00100000:1.0:1782727534.251466:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782727534.251481:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325100168960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727534.251514:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325100168960:12345-0@lo:400:kworker.0 Request processed in 42us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727534.251520:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782727534.251531:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782727534.251536:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325100169088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727534.251556:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325100169088:12345-0@lo:400:kworker.0 Request processed in 20us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727534.251561:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782727534.251591:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325100169088:0@lo:400:kworker.0 00000100:00100000:1.0:1782727534.251599:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37e3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325100168960:0@lo:400:kworker.0 00000100:00100000:0.0:1782727534.251916:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100169216:0@lo:400:kworker.0 00000100:00100000:0.0:1782727534.251944:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727534.251977:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782727534.251982:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37e3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100168832:0@lo:400:kworker.0 00000100:00100000:0.0:1782727534.252005:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727534.252024:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325100169344:0@lo:400:kworker.0 00000100:00100000:0.0:1782727534.252039:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727534.252058:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100168832 00000100:00100000:0.0:1782727534.252061:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100168832 00000100:00100000:0.0:1782727534.252092:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1782727534.252097:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3445:x1869325100168832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727534.252134:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3445:x1869325100168832:12345-0@lo:400:kworker.0 Request processed in 37us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727534.252140:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1782727534.252173:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37e3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100168832:0@lo:400:kworker.0 00000100:00100000:0.0:1782727534.252185:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100169344 00000100:00100000:0.0:1782727534.252188:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100169344 00000100:00100000:0.0:1782727534.252206:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782727534.252211:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325100169344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727534.252235:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325100169344:12345-0@lo:400:kworker.0 Request processed in 24us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727534.252240:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782727534.252259:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325100169344:0@lo:400:kworker.0 00000100:00080000:2.0:1782727534.252364:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727534.252737:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100169216 00000100:00100000:1.0:1782727534.252741:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100169216 00000100:00100000:1.0:1782727534.252774:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782727534.252780:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100169216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727534.252814:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100169216:12345-0@lo:400:kworker.0 Request processed in 34us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727534.252820:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1782727534.252842:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae37c98e00 x1869325100169216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727534.252853:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100169216:0@lo:400:kworker.0 00000100:00080000:2.0:1782727534.253023:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782727534.634617:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727535.654654:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782727536.529935:0:11468:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782727536.530170:0:11468:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782727536.680441:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727537.710702:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727537.839967:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727537.840075:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dfc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100169472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727537.840177:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727537.840784:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100169472 00000100:00100000:0.0:1782727537.840796:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100169472 00000100:00100000:0.0:1782727537.840893:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782727537.840904:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b39f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100169472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727537.840942:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727537.841022:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b39f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100169472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727537.841030:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1782727537.841110:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782727537.841412:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3dfc5f80 x1869325100169472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727537.841433:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dfc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100169472:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782727538.725747:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727538.993620:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727538.993680:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727538.993744:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080209920 00000100:00100000:2.0:1782727538.993756:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080209920 00000100:00100000:2.0:1782727538.993839:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 82 00000100:00100000:2.0:1782727538.993850:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2351:x1869325080209920:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1782727538.993958:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2351:x1869325080209920:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 110us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727538.993980:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 82 00000100:00100000:3.0:1782727538.995681:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080209792 00000100:00100000:3.0:1782727538.995697:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080209792 00000100:00100000:3.0:1782727538.995841:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 215 00000100:00100000:3.0:1782727538.995853:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2351:x1869325080209792:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1782727538.995935:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2351:x1869325080209792:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 85us (2253us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727538.995942:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 215 00000100:00080000:1.0:1782727538.996487:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000004:1.0:1782727539.120868:0:11565:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782727539.122616:0:11565:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1782727539.365648:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37c9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100169984:0@lo:400:kworker.0 00000100:00100000:1.0:1782727539.365749:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727539.365839:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782727539.365846:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100169600:0@lo:400:kworker.0 00000100:00100000:1.0:1782727539.365879:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727539.365901:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325100170112:0@lo:400:kworker.0 00000100:00100000:1.0:1782727539.365926:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727539.365955:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37c99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325100169728:0@lo:400:kworker.0 00000100:00100000:1.0:1782727539.365979:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727539.365995:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37c99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100170240:0@lo:400:kworker.0 00000100:00100000:1.0:1782727539.366014:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727539.366031:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727539.366037:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325100169856:0@lo:400:kworker.0 00000100:00100000:1.0:1782727539.366058:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727539.366093:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100169984 00000100:00100000:1.0:1782727539.366102:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100169984 00000100:00100000:1.0:1782727539.366163:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100170240 00000100:00100000:1.0:1782727539.366166:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100170240 00000100:00100000:1.0:1782727539.366184:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782727539.366208:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100169984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727539.366286:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100169984:12345-0@lo:400:kworker.0 Request processed in 80us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727539.366294:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782727539.366313:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782727539.366320:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100170240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727539.366352:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100170240:12345-0@lo:400:kworker.0 Request processed in 32us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727539.366358:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782727539.366415:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100170112 00000100:00100000:1.0:1782727539.366419:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100170112 00000100:00100000:1.0:1782727539.366446:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100169728 00000100:00100000:1.0:1782727539.366449:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100169728 00000100:00100000:1.0:1782727539.366459:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100169856 00000100:00100000:1.0:1782727539.366461:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100169856 00000100:00100000:1.0:1782727539.366476:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782727539.366481:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325100170112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727539.366512:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325100170112:12345-0@lo:400:kworker.0 Request processed in 30us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727539.366517:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782727539.366527:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782727539.366532:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325100169728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727539.366558:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325100169728:12345-0@lo:400:kworker.0 Request processed in 25us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727539.366563:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782727539.366573:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1782727539.366578:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325100169856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727539.366615:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325100169856:12345-0@lo:400:kworker.0 Request processed in 36us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727539.366621:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1782727539.366649:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782727539.366654:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727539.366656:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727539.366698:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325100169856:0@lo:400:kworker.0 00000100:00100000:1.0:1782727539.366709:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37c99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325100169728:0@lo:400:kworker.0 00010000:00080000:1.0:1782727539.366722:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae37c99c00 x1869325100170240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727539.366733:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37c99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100170240:0@lo:400:kworker.0 00000100:00100000:1.0:1782727539.366765:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325100170112:0@lo:400:kworker.0 00010000:00080000:1.0:1782727539.366775:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae37c9a300 x1869325100169984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727539.366784:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37c9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100169984:0@lo:400:kworker.0 00000100:00100000:0.0:1782727539.367001:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100169600 00000100:00100000:0.0:1782727539.367007:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100169600 00000100:00100000:0.0:1782727539.367052:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1782727539.367058:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100169600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727539.367107:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100169600:12345-0@lo:400:kworker.0 Request processed in 49us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727539.367114:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1782727539.367163:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100169600:0@lo:400:kworker.0 00000100:00100000:0.0:1782727539.376593:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727539.376625:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b39dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100170368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727539.376720:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727539.376814:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100170368 00000100:00100000:3.0:1782727539.376824:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100170368 00000100:00100000:3.0:1782727539.376893:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782727539.376905:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100170368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727539.376949:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727539.377004:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100170368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727539.377021:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1782727539.377170:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b39dc00 x1869325100170368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727539.377201:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b39dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100170368:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782727539.749681:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727540.782139:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727541.799558:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727542.821758:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727542.950217:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dde1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100170496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727542.950317:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727542.950521:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100170496 00000100:00100000:3.0:1782727542.950531:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100170496 00000100:00100000:3.0:1782727542.950624:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782727542.950637:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e14c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100170496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727542.950678:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00080000:0.0:1782727542.950790:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727542.950989:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e14c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100170496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 353us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727542.950997:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1782727542.951018:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3dde1f80 x1869325100170496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727542.951050:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dde1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100170496:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1782727543.724831:0:11710:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1782727543.848063:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727544.114024:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727544.114178:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080210048 00000100:00100000:2.0:1782727544.114193:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080210048 00000100:00100000:2.0:1782727544.114277:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 217 00000100:00100000:2.0:1782727544.114290:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2352:x1869325080210048:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1782727544.118564:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2352:x1869325080210048:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 4257us (4533us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727544.118587:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 217 00000100:00100000:1.0:1782727544.119213:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727544.119306:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080210176 00000100:00100000:2.0:1782727544.119320:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080210176 00000100:00100000:2.0:1782727544.119454:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 86 00000100:00100000:2.0:1782727544.119467:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2352:x1869325080210176:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1782727544.119560:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2352:x1869325080210176:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 97us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727544.119568:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 86 00000100:00080000:0.0:1782727544.121507:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727544.488574:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b39d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100170624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727544.488691:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727544.488743:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100170624 00000100:00100000:2.0:1782727544.488758:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100170624 00000100:00100000:2.0:1782727544.488852:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782727544.488863:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dde1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100170624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727544.488917:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00080000:3.0:1782727544.488952:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782727544.489009:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dde1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100170624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727544.489019:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1782727544.489064:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3b39d880 x1869325100170624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727544.489102:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b39d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100170624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727544.489426:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100170752:0@lo:400:kworker.0 00000100:00100000:3.0:1782727544.489479:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727544.489518:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727544.489525:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325100170880:0@lo:400:kworker.0 00000100:00100000:3.0:1782727544.489552:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727544.489599:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100170752 00000100:00100000:3.0:1782727544.489606:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100170752 00000100:00100000:2.0:1782727544.489621:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727544.489638:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1869325100171264:0@lo:400:kworker.0 00000100:00100000:3.0:1782727544.489673:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1782727544.489684:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3445:x1869325100170752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727544.489696:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727544.489748:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100170880 00000100:00100000:3.0:1782727544.489750:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3445:x1869325100170752:12345-0@lo:400:kworker.0 Request processed in 66us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727544.489757:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100170880 00000100:00100000:3.0:1782727544.489763:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1782727544.489802:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100171264 00000100:00100000:2.0:1782727544.489808:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100171264 00000100:00100000:3.0:1782727544.489843:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325100171008:0@lo:400:kworker.0 00000100:00100000:2.0:1782727544.489857:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782727544.489869:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b39ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325100170880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727544.489903:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727544.489934:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727544.489939:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b39ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325100170880:12345-0@lo:400:kworker.0 Request processed in 68us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727544.489947:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100171136:0@lo:400:kworker.0 00000100:00100000:2.0:1782727544.489952:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782727544.489965:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100171008 00000100:00100000:2.0:1782727544.489970:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100171008 00000100:00100000:2.0:1782727544.489998:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782727544.490016:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e14ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869325100171264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727544.490017:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727544.490075:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e14ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869325100171264:12345-0@lo:400:kworker.0 Request processed in 68us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727544.490081:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782727544.490107:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1782727544.490113:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b39c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325100171008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727544.490144:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b39c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325100171008:12345-0@lo:400:kworker.0 Request processed in 31us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727544.490159:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1782727544.490183:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727544.490214:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1869325100171264:0@lo:400:kworker.0 00000100:00100000:2.0:1782727544.490246:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325100170880:0@lo:400:kworker.0 00000100:00100000:2.0:1782727544.490256:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100170752:0@lo:400:kworker.0 00000100:00100000:2.0:1782727544.490295:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325100171008:0@lo:400:kworker.0 00000100:00100000:3.0:1782727544.490453:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100171136 00000100:00100000:3.0:1782727544.490461:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100171136 00000100:00100000:2.0:1782727544.490590:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782727544.490598:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100171136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727544.490634:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100171136:12345-0@lo:400:kworker.0 Request processed in 37us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727544.490641:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1782727544.490669:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3e14f100 x1869325100171136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727544.490682:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100171136:0@lo:400:kworker.0 00000100:00080000:3.0:1782727544.491252:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782727544.870576:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727545.893506:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727546.925780:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782727547.258473:0:11857:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc325859f0 20000000:00000080:0.0:1782727547.258493:0:11857:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90ae3dfbe400 uarg=0000000000000000 20000000:01000000:0.0:1782727547.258535:0:11857:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782727547.258541:0:11857:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782727547.258551:0:11857:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1782727547.265413:0:11858:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1782727547.265827:0:11857:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1782727547.274644:0:11857:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782727547.274945:0:11857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90ae37da6200/0x8db73d43f5504a22 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727547.274968:0:11857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae033b8400/0x8db73d43f55049f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55049f1 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727547.274987:0:11857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae37da6a00/0x8db73d43f5504a06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f55049ff expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727547.274994:0:11857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae033b9000/0x8db73d43f5504a14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504a0d expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727547.275004:0:11857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ae033b8e00/0x8db73d43f5504a1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577da expref: 9 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727547.275013:0:11857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90ae37da6200/0x8db73d43f5504a22 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727547.275066:0:11857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae033b8e00/0x8db73d43f5504a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577da expref: 9 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727547.275083:0:11857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90ae033b8e00/0x8db73d43f5504a1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577da expref: 9 pid: 5947 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727547.275097:0:11857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37c9b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11857:1869325100171392:192.168.204.35@tcp:104: 00010000:00010000:1.0:1782727547.275279:0:11857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae033b9000/0x8db73d43f5504a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f5504a0d expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727547.275288:0:11857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae033b9000/0x8db73d43f5504a14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f5504a0d expref: 18 pid: 5946 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727547.275299:0:11857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37c99c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11857:1869325100171520:0@lo:104: 00000100:00100000:1.0:1782727547.275338:0:11857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782727547.275410:0:11857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae37da6a00/0x8db73d43f5504a06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f55049ff expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727547.275426:0:11857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae37da6a00/0x8db73d43f5504a06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f55049ff expref: 18 pid: 5944 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727547.275436:0:11857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37c9b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11857:1869325100171648:0@lo:104: 00000100:00100000:1.0:1782727547.275460:0:11857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727547.275493:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100171520 00000100:00100000:1.0:1782727547.275500:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100171520 00000100:00100000:1.0:1782727547.275535:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100171648 00000100:00100000:1.0:1782727547.275538:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100171648 00000100:00100000:1.0:1782727547.275552:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782727547.275559:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37c99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+4:11857:x1869325100171520:12345-0@lo:104: 00010000:00010000:1.0:1782727547.275572:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f5504a14 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727547.275612:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782727547.275617:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37c99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+4:11857:x1869325100171520:12345-0@lo:104: Request processed in 59us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727547.275624:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782727547.275638:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782727547.275644:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37c99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:11857:x1869325100171648:12345-0@lo:104: 00010000:00010000:1.0:1782727547.275661:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae033b8000/0x8db73d43f55049ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f5504a06 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727547.275686:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782727547.275691:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37c99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:11857:x1869325100171648:12345-0@lo:104: Request processed in 48us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727547.275698:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1782727547.275742:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782727547.275750:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f5504a14 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727547.275771:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01539c00 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:3.0:1782727547.275776:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f5504a14 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727547.275785:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f5504a14 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727547.275792:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f5504a14 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727547.275798:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782727547.275828:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504a14 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727547.275835:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727547.275858:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a0d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504a14 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727547.275865:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504a14 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727547.275910:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727547.275914:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae033b8000/0x8db73d43f55049ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f5504a06 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727547.275919:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae033b8000 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:3.0:1782727547.275922:0:5941:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae033b8000/0x8db73d43f55049ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f5504a06 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727547.275929:0:5941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae033b8000/0x8db73d43f55049ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f5504a06 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727547.275935:0:5941:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae033b8000/0x8db73d43f55049ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f5504a06 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727547.275940:0:5941:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782727547.275955:0:5941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae033b8000/0x8db73d43f55049ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504a06 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727547.275960:0:5941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727547.275983:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae033b8000/0x8db73d43f55049ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504a06 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727547.275989:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae033b8000/0x8db73d43f55049ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f5504a06 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727547.275998:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727547.275999:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727547.276001:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727547.276007:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727547.276094:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b39dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100171776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782727547.276129:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727547.276231:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b39e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100171904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782727547.276259:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727547.276882:0:8881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100171776 00000100:00100000:1.0:1782727547.276890:0:8881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100171776 00010000:00010000:1.0:1782727547.276914:0:8881:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae033b9000/0x8db73d43f5504a14 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f5504a0d expref: 19 pid: 5946 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727547.276936:0:8881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100171904 00000100:00100000:1.0:1782727547.276939:0:8881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100171904 00010000:00010000:1.0:1782727547.276949:0:8881:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae37da6a00/0x8db73d43f5504a06 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55049ff expref: 20 pid: 5944 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727547.276967:0:8881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782727547.276975:0:8881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3416dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0332f07-5c7b-4a87-aafc-b3671573fb48+20:3446:x1869325100171776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782727547.276987:0:8881:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727547.276992:0:8881:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae033b9000/0x8db73d43f5504a14 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f5504a0d expref: 20 pid: 5946 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727547.277001:0:8881:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae033b9000/0x8db73d43f5504a14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f5504a0d expref: 20 pid: 5946 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727547.277017:0:8881:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727547.277063:0:8881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3416dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0332f07-5c7b-4a87-aafc-b3671573fb48+20:3446:x1869325100171776:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727547.277070:0:8881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782727547.277116:0:8881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782727547.277122:0:8881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dde3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100171904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782727547.277129:0:8881:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727547.277133:0:8881:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae37da6a00/0x8db73d43f5504a06 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55049ff expref: 19 pid: 5944 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727547.277140:0:8881:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae37da6a00/0x8db73d43f5504a06 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f55049ff expref: 19 pid: 5944 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727547.277158:0:8881:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727547.277181:0:8881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dde3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100171904:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727547.277188:0:8881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1782727547.277299:0:11857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ae033b8400/0x8db73d43f55049f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8db73d43f55049f1 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727547.277310:0:11857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90ae033b8400/0x8db73d43f55049f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8db73d43f55049f1 expref: 18 pid: 5947 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727547.277320:0:11857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37c98000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11857:1869325100172032:0@lo:104: 00000100:00100000:1.0:1782727547.277350:0:11857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727547.279714:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100172032 00000100:00100000:1.0:1782727547.279731:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100172032 00000100:00100000:1.0:1782727547.279796:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782727547.279807:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37c98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:11857:x1869325100172032:12345-0@lo:104: 00010000:00010000:1.0:1782727547.279823:0:5935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55049f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f55049f8 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727547.280123:0:5935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782727547.280130:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37c98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0332f07-5c7b-4a87-aafc-b3671573fb48+3:11857:x1869325100172032:12345-0@lo:104: Request processed in 325us (2780us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727547.280137:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782727547.280182:0:11857:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3b0e63c0 going to sleep for 11 seconds 00010000:00010000:1.0:1782727547.280210:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae033b9000/0x8db73d43f5504a14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f5504a0d expref: 18 pid: 5946 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727547.280290:0:11857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37c99c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11857:1869325100171520:0@lo:104: 00010000:00010000:1.0:1782727547.280326:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae37da6a00/0x8db73d43f5504a06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f55049ff expref: 17 pid: 5944 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727547.280336:0:11857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37c9b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11857:1869325100171648:0@lo:104: 00000100:00100000:1.0:1782727547.280343:0:11857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37c98000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11857:1869325100172032:0@lo:104: 00010000:00010000:3.0:1782727547.281518:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727547.281533:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55049f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8db73d43f55049f8 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727547.281545:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae37da7600 already unused, calling callback (ffffffffc110ec20) 10000000:00010000:3.0:1782727547.281549:0:5940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55049f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8db73d43f55049f8 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727547.281559:0:5940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55049f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8db73d43f55049f8 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727547.281566:0:5940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55049f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8db73d43f55049f8 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727547.281572:0:5940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782727547.283363:0:5940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55049f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55049f8 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727547.283393:0:5940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727547.283411:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55049f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55049f8 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727547.283419:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff90ae37da7600/0x8db73d43f55049f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8db73d43f55049f8 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727547.283441:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727547.283443:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727547.283446:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727547.283472:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b39ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0332f07-5c7b-4a87-aafc-b3671573fb48:3444:1869325100172160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782727547.283598:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727547.283684:0:8881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100172160 00000100:00100000:3.0:1782727547.283692:0:8881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100172160 00010000:00010000:3.0:1782727547.283722:0:8881:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae033b8400/0x8db73d43f55049f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55049f1 expref: 17 pid: 5947 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727547.283750:0:8881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782727547.283770:0:8881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b39ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:3444:x1869325100172160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782727547.283784:0:8881:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727547.283790:0:8881:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae033b8400/0x8db73d43f55049f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8db73d43f55049f1 expref: 17 pid: 5947 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727547.283799:0:8881:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae033b8400/0x8db73d43f55049f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8db73d43f55049f1 expref: 17 pid: 5947 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727547.283814:0:8881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae033b8400/0x8db73d43f55049f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8db73d43f55049f1 expref: 17 pid: 5947 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727547.283827:0:8881:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727547.283859:0:8881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b39ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:3444:x1869325100172160:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727547.283866:0:8881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782727547.285225:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b39ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0332f07-5c7b-4a87-aafc-b3671573fb48:3444:1869325100172160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782727547.285429:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b39dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100171776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782727547.286331:0:11857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37c9b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11857:1869325100171392:192.168.204.35@tcp:104: 00010000:00010000:2.0:1782727547.286362:0:11857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90ae37da6200/0x8db73d43f5504a22 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727547.286491:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b39e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100171904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782727547.286911:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727547.287055:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080210304 00000100:00100000:1.0:1782727547.287063:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080210304 00010000:00010000:1.0:1782727547.287167:0:5937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ae033b8e00/0x8db73d43f5504a1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577da expref: 10 pid: 5947 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727547.287586:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 28 00000100:00100000:2.0:1782727547.287610:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b39ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2350:x1869325080210304:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782727547.287626:0:5939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727547.287646:0:5939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ae033b8e00/0x8db73d43f5504a1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577da expref: 10 pid: 5947 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727547.287672:0:5939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ae033b8e00/0x8db73d43f5504a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577da expref: 10 pid: 5947 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727547.287691:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae033b8e00/0x8db73d43f5504a1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577da expref: 10 pid: 5947 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727547.287706:0:5939:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90ae37da6200/0x8db73d43f5504a22 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727547.287715:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae37da6200/0x8db73d43f5504a22 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727547.287732:0:5939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ae37da6200/0x8db73d43f5504a22 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727547.287739:0:5939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ae37da6200/0x8db73d43f5504a22 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727547.287746:0:5939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90ae37da6200/0x8db73d43f5504a22 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727547.287751:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90ae37da6200/0x8db73d43f5504a22 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727547.287757:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae37da6200 already unused, calling callback (ffffffffc0b2bcf0) 00010000:00010000:2.0:1782727547.287761:0:5939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90ae37da6200/0x8db73d43f5504a22 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727547.287768:0:5939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90ae37da6200/0x8db73d43f5504a22 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727547.287799:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90ae37da6200/0x8db73d43f5504a22 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727547.287810:0:5939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727547.287869:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b39ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+9:2350:x1869325080210304:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 264us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727547.287877:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 28 00010000:00010000:1.0:1782727547.289026:0:11857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90ae37da6200/0x8db73d43f5504a22 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727547.289048:0:11857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90ae37da6200/0x8db73d43f5504a22 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727547.289055:0:11857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ae37da6200/0x8db73d43f5504a22 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727547.943652:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727548.073293:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dde2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100172288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727548.073409:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727548.073526:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100172288 00000100:00100000:2.0:1782727548.073536:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100172288 00000100:00100000:2.0:1782727548.073599:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782727548.073608:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b39c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100172288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727548.073641:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727548.074605:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b39c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100172288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 994us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727548.074615:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1782727548.074705:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3dde2300 x1869325100172288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727564 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727548.074737:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dde2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100172288:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782727548.074829:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727548.340729:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727548.340903:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080210432 00000100:00100000:3.0:1782727548.340914:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080210432 00000100:00100000:3.0:1782727548.340976:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 219 00000100:00100000:3.0:1782727548.340987:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+9:5441:x1869325080210432:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727548.341005:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727548.341034:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae01538000/0x8db73d43f5504a29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9cd528c3973577e1 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727548.341067:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae01538000/0x8db73d43f5504a29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577e1 expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727548.341080:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae01538000/0x8db73d43f5504a29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577e1 expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727548.341090:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae01538000, rc 0) 00000100:00100000:3.0:1782727548.342805:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5441:x1869325080210432:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 1809us (2077us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727548.342820:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 219 00000100:00100000:0.0:1782727548.355656:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727548.355781:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080210560 00000100:00100000:2.0:1782727548.355793:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080210560 00000100:00100000:2.0:1782727548.355849:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 220 00000100:00100000:2.0:1782727548.355859:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5441:x1869325080210560:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727548.356007:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5441:x1869325080210560:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 149us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727548.356024:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 220 00000100:00100000:0.0:1782727548.358795:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727548.358946:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080210688 00000100:00100000:3.0:1782727548.358960:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080210688 00000100:00100000:3.0:1782727548.359035:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 221 00000100:00100000:3.0:1782727548.359047:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5441:x1869325080210688:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727548.359235:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:5441:x1869325080210688:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 189us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727548.359253:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 221 10000000:01000000:3.0:1782727548.837466:0:5949:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782727548.837476:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff90ae3dae6000 from 7 10000000:01000000:3.0:1782727548.837482:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782727548.837534:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727548.837547:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727548.837559:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727548.837588:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b39ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100172416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782727548.837661:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727548.837733:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3dff46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727548.838694:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100172416 00000100:00100000:2.0:1782727548.838707:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100172416 00000100:00100000:2.0:1782727548.838782:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1782727548.838978:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+16:5949:x1869325100172416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727548.839012:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727548.839029:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae033b9400/0x8db73d43f5504a37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f5504a30 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727548.839058:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae033b9400/0x8db73d43f5504a37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f5504a30 expref: 17 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727548.839069:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae033b9400/0x8db73d43f5504a37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504a30 expref: 17 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727548.839077:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae033b9400, rc 0) 00000100:00100000:2.0:1782727548.839153:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100172416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 362us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727548.839161:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1782727548.839365:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b39ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100172416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727548.839411:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504a37 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727548.839421:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f5504a37 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727548.839492:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b39ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100172544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727548.839529:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727548.839566:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100172544 00000100:00100000:3.0:1782727548.839571:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3dff46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727548.839571:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100172544 00000100:00100000:1.0:1782727548.839607:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1782727548.839616:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100172544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727548.839729:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100172544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727548.839736:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1782727548.840565:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b39ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100172544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727548.840621:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b39ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100172672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727548.842433:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727548.842486:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3dff46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727548.842602:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100172672 00000100:00100000:3.0:1782727548.842612:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100172672 00000100:00100000:3.0:1782727548.843045:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1782727548.843056:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100172672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727548.843208:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100172672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727548.843216:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1782727548.843297:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b39ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100172672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782727548.845637:0:11914:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1782727548.845931:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1782727548.845954:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782727548.845966:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504a37 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727548.845978:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae01539c00/0x8db73d43f5504a30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504a37 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727548.845988:0:5949:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782727548.845991:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff90ae06bcd800 from 7 10000000:01000000:2.0:1782727548.845994:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782727548.846041:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae033b8800/0x8db73d43f5504a3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727548.846062:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae033b8800/0x8db73d43f5504a3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727548.846073:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae033b8800/0x8db73d43f5504a3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727548.846098:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100172800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782727548.846305:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727548.846353:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0f55c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727548.846550:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100172800 00000100:00100000:0.0:1782727548.846558:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100172800 00000100:00100000:0.0:1782727548.846611:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1782727548.846621:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+17:5949:x1869325100172800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727548.846637:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727548.846652:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae00030a00/0x8db73d43f5504a45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f5504a3e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727548.846675:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae00030a00/0x8db73d43f5504a45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f5504a3e expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727548.846685:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae00030a00/0x8db73d43f5504a45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504a3e expref: 18 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727548.846694:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae00030a00, rc 0) 00000100:00100000:0.0:1782727548.846747:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100172800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727548.846761:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1782727548.846903:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100172800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727548.846918:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae033b8800/0x8db73d43f5504a3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504a45 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727548.846928:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae033b8800/0x8db73d43f5504a3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f5504a45 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727548.846989:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3b39d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100172928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727548.847032:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727548.848288:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3dff46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727548.848395:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100172928 00000100:00100000:2.0:1782727548.848403:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100172928 00000100:00100000:2.0:1782727548.848458:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1782727548.848467:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100172928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727548.848619:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100172928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727548.848626:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1782727548.848744:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3b39d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100172928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727548.848791:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dde3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100173056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727548.848836:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727548.848860:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3e0b09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727548.848915:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100173056 00000100:00100000:2.0:1782727548.848920:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100173056 00000100:00100000:2.0:1782727548.848954:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1782727548.848962:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100173056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727548.849054:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100173056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727548.849061:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1782727548.849360:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dde3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100173056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782727548.856935:0:11915:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1782727548.857411:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1782727548.857438:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782727548.857449:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae033b8800/0x8db73d43f5504a3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504a45 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727548.857473:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae033b8800/0x8db73d43f5504a3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504a45 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727548.857484:0:5949:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782727548.857486:0:5949:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff90ae052c9800 from 7 10000000:01000000:2.0:1782727548.857489:0:5949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782727548.857521:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae033b9c00/0x8db73d43f5504a4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727548.857528:0:5949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff90ae033b9c00/0x8db73d43f5504a4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727548.857539:0:5949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff90ae033b9c00/0x8db73d43f5504a4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727548.857561:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100173184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782727548.857627:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727548.857667:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0f55c000 going to sleep for 11 seconds 00000100:00100000:0.0:1782727548.857946:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100173184 00000100:00100000:0.0:1782727548.857953:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100173184 00000100:00100000:0.0:1782727548.857996:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1782727548.858017:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae315d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+18:5949:x1869325100173184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727548.858030:0:5946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727548.858043:0:5946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504a53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db73d43f5504a4c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727548.858293:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504a53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8db73d43f5504a4c expref: 19 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727548.858305:0:5946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ae00030e00/0x8db73d43f5504a53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8db73d43f5504a4c expref: 19 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727548.858314:0:5946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae00030e00, rc 0) 00000100:00100000:0.0:1782727548.858365:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae315d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:5949:x1869325100173184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 350us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727548.858390:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1782727548.858479:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100173184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727548.858493:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff90ae033b9c00/0x8db73d43f5504a4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504a53 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727548.858502:0:5949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff90ae033b9c00/0x8db73d43f5504a4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8db73d43f5504a53 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727548.858559:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100173312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727548.858584:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727548.858618:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0f55c000 going to sleep for 11 seconds 00000100:00100000:3.0:1782727548.858817:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100173312 00000100:00100000:3.0:1782727548.858823:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100173312 00000100:00100000:3.0:1782727548.858859:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1782727548.858867:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:5949:x1869325100173312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727548.860242:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:5949:x1869325100173312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1296us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727548.860261:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1782727548.860425:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100173312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727548.860468:0:5949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100173440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727548.860509:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727548.860538:0:5949:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae0f55c000 going to sleep for 11 seconds 00000100:00100000:0.0:1782727548.860613:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100173440 00000100:00100000:0.0:1782727548.860618:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100173440 00000100:00100000:0.0:1782727548.860649:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1782727548.860656:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:5949:x1869325100173440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727548.860762:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:5949:x1869325100173440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727548.860769:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1782727548.861347:0:5949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0332f07-5c7b-4a87-aafc-b3671573fb48:5949:1869325100173440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782727548.864624:0:11916:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1782727548.866277:0:5949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1782727548.866312:0:5949:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782727548.866325:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff90ae033b9c00/0x8db73d43f5504a4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504a53 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727548.866339:0:5949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff90ae033b9c00/0x8db73d43f5504a4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8db73d43f5504a53 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727548.966888:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727549.228681:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727549.228723:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727549.228775:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080210944 00000100:00100000:1.0:1782727549.228790:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080210944 00000100:00100000:1.0:1782727549.228851:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 90 00000100:00100000:1.0:1782727549.228861:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2353:x1869325080210944:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1782727549.228934:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2353:x1869325080210944:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 75us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727549.228942:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 90 00000100:00080000:1.0:1782727549.228977:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727549.229126:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080210816 00000100:00100000:0.0:1782727549.229131:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080210816 00000100:00100000:0.0:1782727549.229168:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 231 00000100:00100000:0.0:1782727549.229176:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2353:x1869325080210816:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1782727549.229211:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2353:x1869325080210816:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 36us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727549.229217:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 231 00000100:00100000:1.0:1782727549.605597:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325100173952:0@lo:400:kworker.0 00000100:00100000:1.0:1782727549.605672:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727549.605735:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782727549.605742:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325100173568:0@lo:400:kworker.0 00000100:00100000:1.0:1782727549.605767:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727549.605784:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100174080:0@lo:400:kworker.0 00000100:00100000:1.0:1782727549.605808:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727549.605854:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37c99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100173824:0@lo:400:kworker.0 00000100:00100000:1.0:1782727549.605878:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727549.605897:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727549.605902:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325100173696:0@lo:400:kworker.0 00000100:00100000:1.0:1782727549.605925:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727549.605954:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100173952 00000100:00100000:1.0:1782727549.605964:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100173952 00000100:00100000:1.0:1782727549.606023:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100173568 00000100:00100000:1.0:1782727549.606026:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100173568 00000100:00100000:1.0:1782727549.606036:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100173696 00000100:00100000:1.0:1782727549.606038:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100173696 00000100:00100000:1.0:1782727549.606053:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782727549.606060:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325100173952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727549.606136:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325100173952:12345-0@lo:400:kworker.0 Request processed in 75us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727549.606144:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782727549.606164:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782727549.606170:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325100173568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727549.606331:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1869325100173568:12345-0@lo:400:kworker.0 Request processed in 28us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727549.606339:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782727549.606353:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782727549.606361:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325100173696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727549.606417:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325100173696:12345-0@lo:400:kworker.0 Request processed in 57us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727549.606423:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782727549.606447:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100174080 00000100:00100000:1.0:1782727549.606451:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100174080 00000100:00100000:1.0:1782727549.606475:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100173824 00000100:00100000:1.0:1782727549.606479:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100173824 00000100:00100000:1.0:1782727549.606490:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782727549.606495:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3daf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100174080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727549.606529:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3daf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100174080:12345-0@lo:400:kworker.0 Request processed in 32us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727549.606535:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782727549.606546:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782727549.606552:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dafb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100173824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727549.606577:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dafb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100173824:12345-0@lo:400:kworker.0 Request processed in 25us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727549.606592:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1782727549.606616:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727549.606621:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727549.606656:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325100173696:0@lo:400:kworker.0 00010000:00080000:1.0:1782727549.606669:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae37c99c00 x1869325100173824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727549.606679:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37c99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100173824:0@lo:400:kworker.0 00000100:00100000:1.0:1782727549.606708:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1869325100173568:0@lo:400:kworker.0 00010000:00080000:1.0:1782727549.606719:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae37c9ad80 x1869325100174080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727549.606727:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100174080:0@lo:400:kworker.0 00000100:00100000:1.0:1782727549.606737:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325100173952:0@lo:400:kworker.0 00000100:00100000:1.0:1782727549.607037:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727549.607047:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100174208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727549.609384:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727549.610360:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100174208 00000100:00100000:0.0:1782727549.610401:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100174208 00000100:00100000:0.0:1782727549.610478:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782727549.610487:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37c99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100174208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727549.610521:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727549.610599:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37c99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100174208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (3520us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727549.610607:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1782727549.610848:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3df93480 x1869325100174208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727549.610871:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100174208:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782727549.989537:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782727550.900762:0:12055:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1782727551.019894:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727552.051115:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727553.061715:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727553.192141:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dde3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100174336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727553.192229:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727553.192394:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100174336 00000100:00100000:0.0:1782727553.192404:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100174336 00000100:00100000:0.0:1782727553.192470:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782727553.192481:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100174336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727553.192510:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727553.192564:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100174336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727553.192571:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1782727553.192628:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727553.192887:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3dde3480 x1869325100174336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727569 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727553.192908:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dde3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100174336:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782727554.088751:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727554.354010:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727554.354069:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727554.354162:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080211072 00000100:00100000:2.0:1782727554.354172:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080211072 00000100:00100000:2.0:1782727554.354221:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 232 00000100:00100000:2.0:1782727554.354230:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2353:x1869325080211072:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1782727554.354299:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2353:x1869325080211072:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 69us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727554.354307:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 232 00000100:00100000:3.0:1782727554.355283:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080211200 00000100:00100000:3.0:1782727554.355290:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080211200 00000100:00100000:3.0:1782727554.355345:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 94 00000100:00100000:3.0:1782727554.355353:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dde1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2353:x1869325080211200:12345-192.168.204.35@tcp:400:kworker.0 00000100:00080000:0.0:1782727554.355404:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727554.355419:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dde1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2353:x1869325080211200:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 67us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727554.355426:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 94 00000100:00100000:3.0:1782727554.725613:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae37c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100174464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727554.725690:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727554.725756:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727554.725762:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100174976:0@lo:400:kworker.0 00000100:00100000:2.0:1782727554.725776:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325100174720:0@lo:400:kworker.0 00000100:00100000:3.0:1782727554.725788:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727554.725804:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100174592:0@lo:400:kworker.0 00000100:00100000:2.0:1782727554.725805:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727554.725821:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727554.725842:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325100174848:0@lo:400:kworker.0 00000100:00100000:3.0:1782727554.725844:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727554.725864:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727554.725868:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727554.725873:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e14fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325100175104:0@lo:400:kworker.0 00000100:00100000:3.0:1782727554.725905:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727554.725907:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100174720 00000100:00100000:2.0:1782727554.725913:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100174720 00000100:00100000:3.0:1782727554.725928:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100174592 00000100:00100000:3.0:1782727554.725931:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100174592 00000100:00100000:2.0:1782727554.725952:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100174848 00000100:00100000:2.0:1782727554.725954:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100174848 00000100:00100000:3.0:1782727554.725964:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1782727554.725972:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3445:x1869325100174592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727554.725972:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100175104 00000100:00100000:2.0:1782727554.725975:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100175104 00000100:00100000:2.0:1782727554.725987:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782727554.725991:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e14df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325100174720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727554.726021:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e14df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325100174720:12345-0@lo:400:kworker.0 Request processed in 29us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727554.726029:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1782727554.726030:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3445:x1869325100174592:12345-0@lo:400:kworker.0 Request processed in 59us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727554.726035:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1782727554.726044:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1782727554.726049:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e14d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325100174848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727554.726061:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782727554.726072:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e14d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1869325100174848:12345-0@lo:400:kworker.0 Request processed in 24us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727554.726163:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100174464 00000100:00100000:1.0:1782727554.726173:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100174464 00000100:00100000:1.0:1782727554.726202:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782727554.726208:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b39f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100174464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727554.726294:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727554.726327:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b39f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100174464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727554.726334:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782727554.726352:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100174976 00000100:00100000:1.0:1782727554.726355:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100174976 00000100:00100000:1.0:1782727554.726404:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782727554.726411:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b39d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100174976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727554.726439:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b39d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100174976:12345-0@lo:400:kworker.0 Request processed in 29us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727554.726444:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1782727554.726507:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782727554.726511:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727554.726596:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b39ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325100175104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727554.726626:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b39ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325100175104:12345-0@lo:400:kworker.0 Request processed in 33us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727554.727215:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1782727554.727254:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1869325100174848:0@lo:400:kworker.0 00000100:00100000:1.0:1782727554.727254:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325100175104:0@lo:400:kworker.0 00000100:00100000:2.0:1782727554.727265:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325100174720:0@lo:400:kworker.0 00010000:00080000:1.0:1782727554.727266:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3e14c700 x1869325100174976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727554.727276:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100174976:0@lo:400:kworker.0 00000100:00100000:1.0:1782727554.727284:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100174592:0@lo:400:kworker.0 00010000:00080000:1.0:1782727554.727294:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae37c98000 x1869325100174464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727570 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727554.727307:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae37c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100174464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727554.727498:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00010000:0.0:1782727555.109771:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782727555.755510:0:12204:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: finish setup 06:05:53 (1782727553) === 00000100:00100000:0.0:1782727555.859191:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727555.859339:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080211328 00000100:00100000:1.0:1782727555.859361:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080211328 00000100:00100000:1.0:1782727555.859449:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:1.0:1782727555.859458:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dde1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+6:7460:x1869325080211328:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:1.0:1782727555.859479:0:8842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727555.860904:0:8842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7c00/0x8db73d43f5504a5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c3973577e8 expref: -99 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861021:0:8842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6800/0x8db73d43f5504a61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861038:0:8842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6800/0x8db73d43f5504a61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861055:0:8842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6800/0x8db73d43f5504a61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861076:0:8842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7600/0x8db73d43f5504a68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861083:0:8842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7600/0x8db73d43f5504a68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861090:0:8842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7600/0x8db73d43f5504a68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861177:0:8842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6800/0x8db73d43f5504a61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861185:0:8842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6800/0x8db73d43f5504a61 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861192:0:8842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6800/0x8db73d43f5504a61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861214:0:8842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae37da6800 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:1.0:1782727555.861220:0:8842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6800/0x8db73d43f5504a61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861228:0:8842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6800/0x8db73d43f5504a61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861243:0:8842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3b217c00) 00010000:00010000:1.0:1782727555.861246:0:8842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727555.861251:0:8842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6800/0x8db73d43f5504a61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861258:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6800/0x8db73d43f5504a61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861277:0:8842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7600/0x8db73d43f5504a68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861283:0:8842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7600/0x8db73d43f5504a68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861289:0:8842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7600/0x8db73d43f5504a68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861294:0:8842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae37da7600 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:1.0:1782727555.861297:0:8842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7600/0x8db73d43f5504a68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861303:0:8842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7600/0x8db73d43f5504a68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861594:0:8842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54ef8a6e (ffff90ae106df300) 00010000:00010000:1.0:1782727555.861597:0:8842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727555.861600:0:8842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7600/0x8db73d43f5504a68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861607:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7600/0x8db73d43f5504a68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861652:0:8842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7c00/0x8db73d43f5504a5a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577e8 expref: 7 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861661:0:8842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3b217c00) 00010000:00010000:1.0:1782727555.861664:0:8842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782727555.861668:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7c00/0x8db73d43f5504a5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577e8 expref: 7 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727555.861677:0:8842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae37da7c00, rc 0) 00000100:00100000:1.0:1782727555.861803:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dde1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+6:7460:x1869325080211328:12345-192.168.204.35@tcp:101:bash.0 Request processed in 2344us (2624us total) trans 0 rc 301/301 00000100:00100000:1.0:1782727555.861813:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:0.0:1782727555.881656:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727555.881894:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080211456 00000100:00100000:3.0:1782727555.881908:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080211456 00000100:00100000:3.0:1782727555.881993:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00100000:3.0:1782727555.882006:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dde2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:7460:x1869325080211456:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:3.0:1782727555.882027:0:5952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727555.882049:0:5952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538200/0x8db73d43f5504a6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c3973577ef expref: -99 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882111:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504a76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882126:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504a76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882139:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504a76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882157:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504a7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882165:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504a7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882172:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504a7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882243:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504a76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882250:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504a76 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882257:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504a76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882263:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01538800 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:3.0:1782727555.882268:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504a76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882275:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504a76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882290:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3b217c00) 00010000:00010000:3.0:1782727555.882315:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727555.882319:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504a76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882325:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504a76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882340:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504a7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882346:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504a7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882352:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504a7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882365:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01538e00 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:3.0:1782727555.882367:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504a7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882410:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504a7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882423:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x77bdd2c7 (ffff90ae03598100) 00010000:00010000:3.0:1782727555.882427:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727555.882431:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504a7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882438:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504a7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882477:0:5952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538200/0x8db73d43f5504a6f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577ef expref: 7 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882489:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3b217c00) 00010000:00010000:3.0:1782727555.882492:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782727555.882497:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538200/0x8db73d43f5504a6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577ef expref: 7 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727555.882507:0:5952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae01538200, rc 0) 00000100:00100000:3.0:1782727555.882578:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dde2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:7460:x1869325080211456:12345-192.168.204.35@tcp:101:bash.0 Request processed in 575us (935us total) trans 0 rc 301/301 00000100:00100000:3.0:1782727555.882586:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00100000:1.0:1782727555.890192:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727555.890361:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080211584 00000100:00100000:0.0:1782727555.890395:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080211584 00000100:00100000:0.0:1782727555.890453:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1 00000100:00100000:0.0:1782727555.890463:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:7460:x1869325080211584:12345-192.168.204.35@tcp:37:bash.0 00000100:00100000:0.0:1782727555.899777:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:7460:x1869325080211584:12345-192.168.204.35@tcp:37:bash.0 Request processed in 9299us (9583us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727555.899798:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1 00000100:00100000:0.0:1782727555.933096:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727555.933224:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080211712 00000100:00100000:2.0:1782727555.933234:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080211712 00000100:00100000:2.0:1782727555.933297:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:2.0:1782727555.933309:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dde0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+6:10351:x1869325080211712:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:2.0:1782727555.933333:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727555.933355:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504a84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c3973577f6 expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933472:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504a8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933488:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504a8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933499:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504a8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933562:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504a92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933570:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504a92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933578:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504a92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933625:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504a8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933632:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504a8b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933638:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504a8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933644:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae033b9600 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:2.0:1782727555.933649:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504a8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933667:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504a8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933681:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3b217c00) 00010000:00010000:2.0:1782727555.933684:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727555.933690:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504a8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933695:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504a8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933707:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504a92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933713:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504a92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933719:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504a92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933723:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae033b8e00 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:2.0:1782727555.933725:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504a92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933731:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504a92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933737:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3d64192e (ffff90ae3b217200) 00010000:00010000:2.0:1782727555.933740:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727555.933742:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504a92 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933760:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504a92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933796:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504a84 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577f6 expref: 7 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933808:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3b217c00) 00010000:00010000:2.0:1782727555.933810:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727555.933814:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504a84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577f6 expref: 7 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727555.933823:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae033b8200, rc 0) 00000100:00100000:2.0:1782727555.933902:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dde0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+6:10351:x1869325080211712:12345-192.168.204.35@tcp:101:rm.0 Request processed in 595us (820us total) trans 0 rc 301/301 00000100:00100000:2.0:1782727555.933909:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:1.0:1782727556.016841:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727556.016953:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727556.017034:0:5961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080211968 00000100:00100000:0.0:1782727556.017050:0:5961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080211968 00000100:00100000:0.0:1782727556.017127:0:5961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00100000:0.0:1782727556.017150:0:5961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:10354:x1869325080211968:12345-192.168.204.35@tcp:700:mkdir.0 00000100:00100000:0.0:1782727556.017232:0:5961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:10354:x1869325080211968:12345-192.168.204.35@tcp:700:mkdir.0 Request processed in 85us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727556.017240:0:5961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00080000:1.0:1782727556.017363:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727556.017737:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080211840 00000100:00100000:3.0:1782727556.017845:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080211840 00000100:00100000:3.0:1782727556.017900:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:3.0:1782727556.017908:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2352:x1869325080211840:12345-192.168.204.35@tcp:41:mkdir.0 00000004:00000024:3.0:1782727556.017938:0:5953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:3.0:1782727556.018003:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2352:x1869325080211840:12345-192.168.204.35@tcp:41:mkdir.0 Request processed in 95us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727556.018011:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:1.0:1782727556.024448:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727556.028314:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080212224 00000100:00100000:2.0:1782727556.028331:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080212224 00000100:00100000:2.0:1782727556.028433:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:2.0:1782727556.028444:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+6:10354:x1869325080212224:12345-192.168.204.35@tcp:36:mkdir.0 00010000:00010000:2.0:1782727556.028504:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727556.028534:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae0a3c7e00/0x8db73d43f550496c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577c5 expref: 6 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.028555:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3b217c00) 00010000:00010000:2.0:1782727556.028566:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782727556.028623:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504a99 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.028653:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504a99 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.028662:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504a99 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.028732:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504aa0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.028741:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.028748:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727556.029404:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1782727556.029419:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504a99 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.029426:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504a99 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.029433:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504a99 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.029439:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae033b8200 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:2.0:1782727556.029443:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504a99 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.029450:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504a99 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.029474:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3b217200) 00010000:00010000:2.0:1782727556.029477:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727556.029481:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504a99 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.029486:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504a99 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782727556.029503:0:5954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b29e229b reply state 00000000d9ca07d3 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727556.029512:0:5954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782727556.029622:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+7:10354:x1869325080212224:12345-192.168.204.35@tcp:36:mkdir.0 Request processed in 1178us (5184us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1782727556.029630:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 14 00010000:00010000:0.0:1782727556.035011:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.035031:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504aa0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.035038:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504aa0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.035044:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae033b8e00 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:0.0:1782727556.035048:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504aa0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.035055:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504aa0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.035075:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90ae3b217300) 00010000:00010000:0.0:1782727556.035078:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727556.035083:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504aa0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.035089:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8e00/0x8db73d43f5504aa0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727556.062319:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727556.063535:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080212352 00000100:00100000:3.0:1782727556.063550:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080212352 00000100:00100000:3.0:1782727556.063609:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00100000:3.0:1782727556.063620:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e14f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+6:10355:x1869325080212352:12345-192.168.204.35@tcp:101:chmod.0 00010000:00010000:3.0:1782727556.063644:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727556.063665:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538200/0x8db73d43f5504aa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c3973577fd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.063733:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504aae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.063747:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.063759:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727556.063808:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782727556.063813:0:5953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782727556.063845:0:5953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.063881:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538200/0x8db73d43f5504aa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577fd expref: 8 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.063906:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504aae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577fd expref: 7 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.063914:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae03598100) 00010000:00010000:3.0:1782727556.063917:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782727556.063919:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae01538e00, rc 0) 00000100:00100000:3.0:1782727556.063981:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e14f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+7:10355:x1869325080212352:12345-192.168.204.35@tcp:101:chmod.0 Request processed in 363us (1694us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727556.063988:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00100000:3.0:1782727556.077013:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727556.077271:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080212608 00000100:00100000:1.0:1782727556.077282:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080212608 00000100:00100000:1.0:1782727556.077345:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:1.0:1782727556.077395:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b39e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+7:10355:x1869325080212608:12345-192.168.204.35@tcp:36:chmod.0 00010000:00010000:1.0:1782727556.077451:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727556.077477:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504aae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973577fd expref: 7 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.077497:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae03598100) 00010000:00010000:1.0:1782727556.077521:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782727556.077556:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504ab5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.077569:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.077578:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782727556.077762:0:5954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007cd28846 reply state 00000000b65713ae transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727556.077771:0:5954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782727556.077779:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1782727556.077855:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b39e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+8:10355:x1869325080212608:12345-192.168.204.35@tcp:36:chmod.0 Request processed in 485us (856us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1782727556.077877:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 16 00010000:00010000:1.0:1782727556.082949:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.082972:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504ab5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.082979:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504ab5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.083000:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae37da6e00 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:1.0:1782727556.083005:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504ab5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.083013:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504ab5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.083032:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae106df300) 00010000:00010000:1.0:1782727556.083035:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782727556.083039:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504ab5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.083045:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504ab5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727556.112436:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727556.112553:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080212736 00000100:00100000:0.0:1782727556.112577:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080212736 00000100:00100000:0.0:1782727556.112639:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:0.0:1782727556.112649:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e14c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+7:10356:x1869325080212736:12345-192.168.204.35@tcp:101:chown.0 00010000:00010000:0.0:1782727556.112674:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727556.112701:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504abc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c397357804 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.112771:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030000/0x8db73d43f5504ac3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.112784:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030000/0x8db73d43f5504ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.112795:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030000/0x8db73d43f5504ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727556.112846:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782727556.112849:0:5953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727556.112894:0:5953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030000/0x8db73d43f5504ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.112920:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504abc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357804 expref: 9 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.112936:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030000/0x8db73d43f5504ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357804 expref: 8 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.112945:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3db01400) 00010000:00010000:0.0:1782727556.112948:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782727556.112951:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae00030000, rc 0) 00000100:00100000:0.0:1782727556.113012:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e14c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+8:10356:x1869325080212736:12345-192.168.204.35@tcp:101:chown.0 Request processed in 364us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727556.113018:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:2.0:1782727556.115550:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727556.115601:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080212864 00000100:00100000:3.0:1782727556.115611:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080212864 00000100:00100000:3.0:1782727556.115673:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00100000:3.0:1782727556.115683:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e14e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+8:10356:x1869325080212864:12345-192.168.204.35@tcp:101:chown.0 00010000:00010000:3.0:1782727556.115704:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727556.115723:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538200/0x8db73d43f5504aca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c39735780b expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.115792:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504ad1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.115806:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504ad1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.115816:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504ad1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.115845:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504ad8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.115874:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.115881:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.115979:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504adf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.115987:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.115995:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727556.116033:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782727556.116036:0:5954:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782727556.116055:0:5954:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.116066:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504ad1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.116086:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504ad1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.116093:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504ad1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.116109:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01538800 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:3.0:1782727556.116113:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504ad1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.116122:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504ad1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.116134:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3db01400) 00010000:00010000:3.0:1782727556.116137:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727556.116142:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504ad1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.116148:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504ad1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.116160:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.116177:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504ad8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.116182:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.116187:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01539800 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:3.0:1782727556.116190:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.116195:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504ad8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.116213:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90ae03598000) 00010000:00010000:3.0:1782727556.116215:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727556.116218:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504ad8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.116223:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504ad8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.116254:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538200/0x8db73d43f5504aca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735780b expref: 10 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.116267:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504adf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735780b expref: 9 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.116273:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90ae03598100) 00010000:00010000:3.0:1782727556.116275:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782727556.116278:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae01538e00, rc 0) 00000100:00100000:3.0:1782727556.116343:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e14e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+9:10356:x1869325080212864:12345-192.168.204.35@tcp:101:chown.0 Request processed in 661us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727556.116352:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00100000:0.0:1782727556.122968:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727556.123052:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080213120 00000100:00100000:3.0:1782727556.123064:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080213120 00000100:00100000:3.0:1782727556.123129:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 19 00000100:00100000:3.0:1782727556.123140:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dde3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+9:10356:x1869325080213120:12345-192.168.204.35@tcp:36:chown.0 00010000:00010000:3.0:1782727556.123200:0:5953:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727556.123229:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504adf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735780b expref: 9 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.123274:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90ae03598100) 00010000:00010000:3.0:1782727556.123286:0:5953:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727556.123326:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538a00/0x8db73d43f5504ae6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.123339:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538a00/0x8db73d43f5504ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.123349:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538a00/0x8db73d43f5504ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782727556.126818:0:5931:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1782727556.126921:0:5953:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009b14c314 reply state 00000000e13afaca transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538a00/0x8db73d43f5504ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727556.126938:0:5953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782727556.126951:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1782727556.127153:0:5953:0:(ldlm_lib.c:3443:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1782727556.127325:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dde3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+7:10356:x1869325080213120:12345-192.168.204.35@tcp:36:chown.0 Request processed in 4180us (4367us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1782727556.127334:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 19 00010000:00010000:0.0:1782727556.130080:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538a00/0x8db73d43f5504ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.130101:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538a00/0x8db73d43f5504ae6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.130109:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538a00/0x8db73d43f5504ae6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.130116:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01538a00 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:0.0:1782727556.130121:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538a00/0x8db73d43f5504ae6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.130130:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538a00/0x8db73d43f5504ae6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.130148:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90ae03598800) 00010000:00010000:0.0:1782727556.130151:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782727556.130155:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538a00/0x8db73d43f5504ae6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.130161:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538a00/0x8db73d43f5504ae6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.134574:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727556.154615:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727556.154786:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080213248 00000100:00100000:3.0:1782727556.154795:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080213248 00000100:00100000:3.0:1782727556.154872:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:3.0:1782727556.154881:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dde0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+6:10357:x1869325080213248:12345-192.168.204.35@tcp:101:touch.500 00010000:00010000:3.0:1782727556.154905:0:8842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727556.154924:0:8842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538200/0x8db73d43f5504aed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c397357812 expref: -99 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782727556.156324:0:8842:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1350us 00010000:00010000:0.0:1782727556.177918:0:8842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504af4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.177950:0:8842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504af4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.177962:0:8842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504af4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.177979:0:8842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030800/0x8db73d43f5504afb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.177986:0:8842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030800/0x8db73d43f5504afb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.177992:0:8842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030800/0x8db73d43f5504afb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.178128:0:8842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031800/0x8db73d43f5504b02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.178137:0:8842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031800/0x8db73d43f5504b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.178145:0:8842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031800/0x8db73d43f5504b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727556.178177:0:8842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782727556.178181:0:8842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727556.178214:0:8842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031800/0x8db73d43f5504b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.178239:0:8842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504af4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.178255:0:8842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504af4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.178262:0:8842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504af4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.178269:0:8842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae00030400 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:0.0:1782727556.178273:0:8842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504af4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.178280:0:8842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504af4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.178293:0:8842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3db01400) 00010000:00010000:0.0:1782727556.178296:0:8842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727556.178300:0:8842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504af4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.178306:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504af4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.178318:0:8842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030800/0x8db73d43f5504afb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.178324:0:8842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030800/0x8db73d43f5504afb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.178329:0:8842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030800/0x8db73d43f5504afb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.178335:0:8842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae00030800 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:0.0:1782727556.178342:0:8842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030800/0x8db73d43f5504afb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.178349:0:8842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030800/0x8db73d43f5504afb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.178356:0:8842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90ae3db01d00) 00010000:00010000:0.0:1782727556.178358:0:8842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727556.178360:0:8842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030800/0x8db73d43f5504afb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.178366:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030800/0x8db73d43f5504afb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.178430:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538200/0x8db73d43f5504aed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357812 expref: 8 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.178444:0:8842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031800/0x8db73d43f5504b02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357812 expref: 7 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.178451:0:8842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90ae3db01f00) 00010000:00010000:0.0:1782727556.178453:0:8842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782727556.178455:0:8842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae00031800, rc 0) 00000100:00100000:0.0:1782727556.178600:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dde0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+7:10357:x1869325080213248:12345-192.168.204.35@tcp:101:touch.500 Request processed in 23718us (23999us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727556.178609:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:2.0:1782727556.196150:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727556.196283:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080213504 00000100:00100000:3.0:1782727556.196294:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080213504 00000100:00100000:3.0:1782727556.196533:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:3.0:1782727556.196546:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e14c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+7:10357:x1869325080213504:12345-192.168.204.35@tcp:101:touch.500 00010000:00010000:3.0:1782727556.196568:0:5952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727556.196588:0:5952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504b09 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c397357819 expref: -99 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.196711:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504b10 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.196726:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504b10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.196738:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504b10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.196752:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504b17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.196758:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.196765:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782727556.197184:0:5952:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1782727556.197357:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538400/0x8db73d43f5504b1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.197502:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538400/0x8db73d43f5504b1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.197511:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538400/0x8db73d43f5504b1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.197547:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504b10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.197564:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504b10 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.197571:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504b10 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.197578:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01539800 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:3.0:1782727556.197582:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504b10 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.197590:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504b10 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.197602:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90ae3db01f00) 00010000:00010000:3.0:1782727556.197604:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727556.197609:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504b10 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.197615:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504b10 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782727556.197629:0:5952:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e78cca6e reply state 00000000ecadc5d8 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727556.197639:0:5952:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782727556.197677:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504b09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357819 expref: 10 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.197690:0:5952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538400/0x8db73d43f5504b1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357819 expref: 9 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.197709:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90ae03597200) 00010000:00010000:3.0:1782727556.197711:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782727556.197713:0:5952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae01538400, rc 0) 00000100:00100000:3.0:1782727556.197778:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e14c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+10:10357:x1869325080213504:12345-192.168.204.35@tcp:101:touch.500 Request processed in 1236us (1642us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1782727556.197786:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 21 00010000:00010000:0.0:1782727556.201504:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.201527:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504b17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.201550:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504b17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.201555:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01538800 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:0.0:1782727556.201559:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504b17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.201566:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504b17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.201582:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xcb02727e (ffff90ae03597a00) 00010000:00010000:0.0:1782727556.201585:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727556.201589:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504b17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.201595:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504b17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727556.206907:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727556.207168:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080213760 00000100:00100000:1.0:1782727556.207179:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080213760 00000100:00100000:0.0:1782727556.207425:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00100000:0.0:1782727556.207437:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e14fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+9:10357:x1869325080213760:12345-192.168.204.35@tcp:36:touch.500 00010000:00010000:0.0:1782727556.207511:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727556.207541:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538400/0x8db73d43f5504b1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357819 expref: 9 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.207559:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90ae03597200) 00010000:00010000:0.0:1782727556.207569:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727556.207624:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.207658:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.207667:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727556.207776:0:5954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008c3b5a1f reply state 00000000af756ee3 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727556.207787:0:5954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782727556.207906:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e14fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+10:10357:x1869325080213760:12345-192.168.204.35@tcp:36:touch.500 Request processed in 470us (1011us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1782727556.207914:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 22 00010000:00010000:1.0:1782727556.210212:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.210744:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.210752:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.210759:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae00030400 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:1.0:1782727556.210763:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.210771:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.210806:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90ae3db01d00) 00010000:00010000:1.0:1782727556.210809:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727556.210814:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b2c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.210820:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727556.213066:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727556.214011:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080213888 00000100:00100000:0.0:1782727556.214024:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080213888 00000100:00100000:0.0:1782727556.214193:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 23 00000100:00100000:0.0:1782727556.214204:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e14f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+9:10357:x1869325080213888:12345-192.168.204.35@tcp:101:touch.500 00010000:00010000:0.0:1782727556.214332:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727556.214660:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031000/0x8db73d43f5504b33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c397357820 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.214720:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031000/0x8db73d43f5504b33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357820 expref: 10 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.214734:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031000/0x8db73d43f5504b33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357820 expref: 10 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.214750:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90ae3db01800) 00010000:00010000:0.0:1782727556.214768:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782727556.214771:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae00031000, rc 0) 00000100:00100000:0.0:1782727556.214889:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e14f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+10:10357:x1869325080213888:12345-192.168.204.35@tcp:101:touch.500 Request processed in 685us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727556.214897:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 23 00000100:00100000:3.0:1782727556.219582:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727556.219679:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080214016 00000100:00100000:1.0:1782727556.219690:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080214016 00000100:00100000:1.0:1782727556.219736:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:1.0:1782727556.219744:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1869325080214016:12345-192.168.204.35@tcp:8:touch.500 00010000:00080000:1.0:1782727556.219774:0:6939:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0000: connection from f875d55c-258d-46bd-8e2e-5a5be22638df@192.168.204.35@tcp t0 exp 0000000000000000 cur 280 last 0 00000020:00000080:1.0:1782727556.219804:0:6939:0:(genops.c:1406:class_connect()) connect: client f875d55c-258d-46bd-8e2e-5a5be22638df, cookie 0x8db73d43f5504b3a 00002000:00100000:1.0:1782727556.219815:0:6939:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f875d55c-258d-46bd-8e2e-5a5be22638df/ffff90ae3df8a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782727556.220141:0:6939:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782727556.220225:0:6939:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782727556.221533:0:6939:0:(import.c:65:import_set_state_nolock()) ffff90ae3df8c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782727556.221634:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2349:x1869325080214016:12345-192.168.204.35@tcp:8:touch.500 Request processed in 1884us (2059us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727556.221647:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:1.0:1782727556.228071:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727556.228166:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080214144 00000100:00100000:0.0:1782727556.228177:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080214144 00000100:00100000:0.0:1782727556.228264:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:0.0:1782727556.228276:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37e3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+6:0:x1869325080214144:12345-192.168.204.35@tcp:2:touch.500 00000100:00080000:1.0:1782727556.228545:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1782727556.245595:0:6933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:0.0:1782727556.245614:0:6933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f875d55c-258d-46bd-8e2e-5a5be22638df 00000100:00100000:1.0:1782727556.246493:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37e3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+5:0:x1869325080214144:12345-192.168.204.35@tcp:2:touch.500 Request processed in 18210us (18426us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1782727556.246508:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:2.0:1782727556.251747:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727556.252226:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080214400 00000100:00100000:0.0:1782727556.252237:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080214400 00000100:00100000:0.0:1782727556.252356:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2 00000100:00100000:0.0:1782727556.252368:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e14f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+10:10357:x1869325080214400:12345-192.168.204.35@tcp:35:touch.500 00000100:00100000:0.0:1782727556.252691:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e14f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+11:10357:x1869325080214400:12345-192.168.204.35@tcp:35:touch.500 Request processed in 324us (954us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1782727556.252700:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2 00000100:00100000:3.0:1782727556.279454:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727556.279772:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080214528 00000100:00100000:2.0:1782727556.279782:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080214528 00000100:00100000:2.0:1782727556.279851:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 24 00000100:00100000:2.0:1782727556.279872:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2a74e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+11:10358:x1869325080214528:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:2.0:1782727556.280108:0:8842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727556.280130:0:8842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504b41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c397357827 expref: -99 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.280198:0:8842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504b48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.280212:0:8842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504b48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.280223:0:8842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504b48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727556.280267:0:8842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782727556.280272:0:8842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727556.280307:0:8842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504b48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.280333:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504b41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357827 expref: 13 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.280353:0:8842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504b48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357827 expref: 12 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.281889:0:8842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90ae3db01f00) 00010000:00010000:2.0:1782727556.281903:0:8842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782727556.281907:0:8842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae033b9a00, rc 0) 00000100:00100000:2.0:1782727556.282000:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2a74e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+12:10358:x1869325080214528:12345-192.168.204.35@tcp:101:rm.0 Request processed in 2128us (2555us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727556.282010:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 24 00000100:00100000:2.0:1782727556.289653:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727556.290069:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080214784 00000100:00100000:3.0:1782727556.290080:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080214784 00000100:00100000:3.0:1782727556.290207:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:3.0:1782727556.290219:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+12:10358:x1869325080214784:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:3.0:1782727556.290242:0:5952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727556.290266:0:5952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504b4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c39735782e expref: -99 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727556.290439:0:5952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1782727556.290591:0:5952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504b4f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735782e expref: 14 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.290606:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3db01400) 00010000:00010000:3.0:1782727556.290609:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782727556.290614:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504b4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735782e expref: 14 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.290629:0:5952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae01538e00, rc 0) 00000100:00100000:3.0:1782727556.290708:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+13:10358:x1869325080214784:12345-192.168.204.35@tcp:101:rm.0 Request processed in 491us (1070us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1782727556.290716:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:3.0:1782727556.295060:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727556.295222:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080214912 00000100:00100000:1.0:1782727556.295233:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080214912 00000100:00100000:1.0:1782727556.295295:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 3 00000100:00100000:1.0:1782727556.295306:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2a74fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+13:10358:x1869325080214912:12345-192.168.204.35@tcp:37:rm.0 00000100:00100000:1.0:1782727556.302547:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2a74fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+13:10358:x1869325080214912:12345-192.168.204.35@tcp:37:rm.0 Request processed in 5646us (5905us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727556.302565:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 3 00000100:00100000:2.0:1782727556.308626:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727556.309187:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080215168 00000100:00100000:0.0:1782727556.309197:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080215168 00000100:00100000:0.0:1782727556.309265:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4 00000100:00100000:0.0:1782727556.309275:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae08383450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+13:10358:x1869325080215168:12345-192.168.204.35@tcp:35:rm.0 00000100:00100000:1.0:1782727556.310687:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae08383450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+14:10358:x1869325080215168:12345-192.168.204.35@tcp:35:rm.0 Request processed in 1404us (2067us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1782727556.310700:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4 00000100:00100000:3.0:1782727556.320919:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727556.323096:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080215424 00000100:00100000:0.0:1782727556.323113:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080215424 00000100:00100000:0.0:1782727556.323201:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00100000:0.0:1782727556.323213:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2a74df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+14:10358:x1869325080215424:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:0.0:1782727556.323254:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727556.323275:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c397357835 expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.323421:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030800/0x8db73d43f5504b64 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.323436:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030800/0x8db73d43f5504b64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.323447:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030800/0x8db73d43f5504b64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727556.323461:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1782727556.323567:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357835 expref: 17 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.323586:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030800/0x8db73d43f5504b64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357835 expref: 16 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.323601:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90ae3db01f00) 00010000:00010000:0.0:1782727556.323604:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782727556.323607:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae00030800, rc 0) 00000100:00100000:0.0:1782727556.323681:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2a74df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+16:10358:x1869325080215424:12345-192.168.204.35@tcp:101:rm.0 Request processed in 469us (2777us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1782727556.323688:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00100000:1.0:1782727556.327742:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727556.328055:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080215552 00000100:00100000:0.0:1782727556.328064:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080215552 00000100:00100000:0.0:1782727556.328128:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 27 00000100:00100000:0.0:1782727556.328155:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+16:10358:x1869325080215552:12345-192.168.204.35@tcp:41:rm.0 00000004:00000024:0.0:1782727556.328208:0:5953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847337984 avail 7384293376 00000100:00100000:0.0:1782727556.328279:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+16:10358:x1869325080215552:12345-192.168.204.35@tcp:41:rm.0 Request processed in 126us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727556.328287:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 27 00000100:00100000:0.0:1782727556.331472:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727556.331540:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080215680 00000100:00100000:2.0:1782727556.331549:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080215680 00000100:00100000:2.0:1782727556.331613:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 28 00000100:00100000:2.0:1782727556.331623:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dde1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+16:10358:x1869325080215680:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:2.0:1782727556.331645:0:8842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727556.331666:0:8842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504b72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c39735783c expref: -99 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.331737:0:8842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504b79 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.331752:0:8842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504b79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.331774:0:8842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504b79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.331790:0:8842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504b80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xcb02727e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.331820:0:8842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504b80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.331836:0:8842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504b80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.331933:0:8842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8400/0x8db73d43f5504b87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.331942:0:8842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8400/0x8db73d43f5504b87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.331949:0:8842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8400/0x8db73d43f5504b87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727556.332267:0:8842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782727556.332272:0:8842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727556.332287:0:8842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8400/0x8db73d43f5504b87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.332296:0:8842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8400/0x8db73d43f5504b87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.332302:0:8842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504b79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.332306:0:8842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504b79 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.332310:0:8842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504b79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.332323:0:8842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae033b8000 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:2.0:1782727556.332326:0:8842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504b79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.332331:0:8842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504b79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.332340:0:8842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90ae3db01f00) 00010000:00010000:2.0:1782727556.332342:0:8842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727556.332345:0:8842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504b79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.332349:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504b79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.332357:0:8842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504b80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.332361:0:8842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504b80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.332366:0:8842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504b80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.332462:0:8842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae033b9000 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:2.0:1782727556.332466:0:8842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504b80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.332473:0:8842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504b80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.332491:0:8842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xcb02727e (ffff90ae3b217200) 00010000:00010000:2.0:1782727556.332494:0:8842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727556.332497:0:8842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504b80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.332502:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504b80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.332537:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504b72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735783c expref: 18 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.332550:0:8842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8400/0x8db73d43f5504b87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735783c expref: 17 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727556.332557:0:8842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90ae3db01800) 00010000:00010000:2.0:1782727556.332559:0:8842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782727556.332561:0:8842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae033b8400, rc 0) 00000100:00100000:2.0:1782727556.332634:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dde1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+17:10358:x1869325080215680:12345-192.168.204.35@tcp:101:rm.0 Request processed in 1011us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727556.332641:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 28 00000100:00100000:2.0:1782727556.336200:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727556.336288:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080215936 00000100:00100000:0.0:1782727556.336299:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080215936 00000100:00100000:0.0:1782727556.336452:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 29 00000100:00100000:0.0:1782727556.336465:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+17:10358:x1869325080215936:12345-192.168.204.35@tcp:36:rm.0 00010000:00010000:0.0:1782727556.336587:0:5953:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782727556.336613:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8400/0x8db73d43f5504b87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735783c expref: 17 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.336630:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031000/0x8db73d43f5504b33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357820 expref: 16 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.336638:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90ae3db01800) 00010000:00010000:0.0:1782727556.336649:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504b48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357827 expref: 15 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.336654:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90ae3db01f00) 00010000:00010000:0.0:1782727556.336656:0:5953:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727556.336671:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b8e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.336681:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.336697:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.336713:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031c00/0x8db73d43f5504b95 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.336720:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031c00/0x8db73d43f5504b95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.336727:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031c00/0x8db73d43f5504b95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.336875:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504b9c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.336899:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504b9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.336906:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504b9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782727556.337145:0:5953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1782727556.337156:0:5953:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 280618782615ns, next at 281618780106ns, rc = 0 00010000:00010000:0.0:1782727556.337215:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504ba3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.337223:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.337230:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.337248:0:5953:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504ba3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.337254:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504ba3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.337259:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504ba3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.337283:0:5953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782727556.337300:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504b9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.337306:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504b9c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.337312:0:5953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504b9c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.337318:0:5953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae013a1200 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:0.0:1782727556.337322:0:5953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504b9c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.337329:0:5953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504b9c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.337338:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90ae3db01900) 00010000:00010000:0.0:1782727556.337341:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782727556.337344:0:5953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504b9c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.337360:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504b9c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.337422:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727556.337428:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504ba3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.337434:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae013a0200 already unused, calling callback (ffffffffc0b2bcf0) 00010000:00010000:3.0:1782727556.337438:0:5941:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504ba3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.337444:0:5941:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504ba3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.337452:0:5941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90ae3db01900) 00010000:00010000:3.0:1782727556.337455:0:5941:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782727556.337457:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504ba3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.337463:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504ba3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727556.337474:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727556.337476:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727556.337478:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727556.337681:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.337700:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b8e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.337707:0:5953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.337713:0:5953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae00030400 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:0.0:1782727556.337716:0:5953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.337721:0:5953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b8e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.337729:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90ae3db01f00) 00010000:00010000:0.0:1782727556.337731:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727556.337734:0:5953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b8e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.337739:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030400/0x8db73d43f5504b8e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727556.337747:0:5953:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000013a15b09 reply state 00000000b63aba7f transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031c00/0x8db73d43f5504b95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727556.337756:0:5953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782727556.337889:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+16:10358:x1869325080215936:12345-192.168.204.35@tcp:36:rm.0 Request processed in 1418us (1694us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1782727556.337904:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 29 00010000:00010000:0.0:1782727556.342352:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031c00/0x8db73d43f5504b95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.342393:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031c00/0x8db73d43f5504b95 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.342401:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031c00/0x8db73d43f5504b95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.342408:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae00031c00 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:0.0:1782727556.342413:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031c00/0x8db73d43f5504b95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.342421:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031c00/0x8db73d43f5504b95 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.342437:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xcb02727e (ffff90ae3db01d00) 00010000:00010000:0.0:1782727556.342441:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727556.342445:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031c00/0x8db73d43f5504b95 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.342452:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031c00/0x8db73d43f5504b95 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xcb02727e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727556.348427:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727556.348525:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080216192 00000100:00100000:1.0:1782727556.348534:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080216192 00000100:00100000:1.0:1782727556.348599:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:1.0:1782727556.348608:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2a74d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+15:10358:x1869325080216192:12345-192.168.204.35@tcp:35:rm.0 00000100:00100000:1.0:1782727556.348843:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2a74d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+16:10358:x1869325080216192:12345-192.168.204.35@tcp:35:rm.0 Request processed in 229us (422us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1782727556.348851:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:1.0:1782727556.353171:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727556.353265:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080216448 00000100:00100000:0.0:1782727556.353276:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080216448 00000100:00100000:0.0:1782727556.353341:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 30 00000100:00100000:0.0:1782727556.353353:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+16:10358:x1869325080216448:12345-192.168.204.35@tcp:36:rm.0 00010000:00010000:0.0:1782727556.353466:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782727556.353492:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030800/0x8db73d43f5504b64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357835 expref: 16 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.353514:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00031800/0x8db73d43f5504b02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357812 expref: 15 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.353526:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90ae3db01f00) 00010000:00010000:0.0:1782727556.353543:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030000/0x8db73d43f5504ac3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357804 expref: 14 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.353551:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3db01400) 00010000:00010000:0.0:1782727556.353557:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727556.353581:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1c00/0x8db73d43f5504baa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.353593:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1c00/0x8db73d43f5504baa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.353603:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1c00/0x8db73d43f5504baa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.353614:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0600/0x8db73d43f5504bb1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.353621:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0600/0x8db73d43f5504bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.353628:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0600/0x8db73d43f5504bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.353717:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504bb8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.353726:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504bb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.353733:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504bb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727556.353978:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1782727556.353992:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504bb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.353999:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504bb8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.354006:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504bb8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.354012:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae013a0800 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:0.0:1782727556.354016:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504bb8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.354023:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504bb8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.354031:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90ae3db01300) 00010000:00010000:0.0:1782727556.354034:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782727556.354037:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504bb8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.354053:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504bb8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.354073:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1c00/0x8db73d43f5504baa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.354079:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1c00/0x8db73d43f5504baa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.354086:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1c00/0x8db73d43f5504baa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.354091:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae013a1c00 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:0.0:1782727556.354093:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1c00/0x8db73d43f5504baa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.354099:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1c00/0x8db73d43f5504baa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.354107:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3db01a00) 00010000:00010000:0.0:1782727556.354109:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727556.354112:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1c00/0x8db73d43f5504baa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727556.354117:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1c00/0x8db73d43f5504baa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727556.354130:0:5954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000607831c0 reply state 000000005b98038c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0600/0x8db73d43f5504bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727556.354140:0:5954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782727556.354224:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+15:10358:x1869325080216448:12345-192.168.204.35@tcp:36:rm.0 Request processed in 872us (1067us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1782727556.354233:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 30 00010000:00010000:1.0:1782727556.357776:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0600/0x8db73d43f5504bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.357799:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0600/0x8db73d43f5504bb1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.357808:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0600/0x8db73d43f5504bb1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.357841:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae013a0600 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:1.0:1782727556.357847:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0600/0x8db73d43f5504bb1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.357864:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0600/0x8db73d43f5504bb1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.357881:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90ae3db01c00) 00010000:00010000:1.0:1782727556.357884:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727556.357889:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0600/0x8db73d43f5504bb1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727556.357904:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0600/0x8db73d43f5504bb1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727557.157894:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727558.182589:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727558.309902:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727558.309927:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dde0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100175232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727558.310004:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727558.310104:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100175232 00000100:00100000:1.0:1782727558.310112:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100175232 00000100:00100000:1.0:1782727558.310174:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782727558.310183:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3b0ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100175232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782727558.310212:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727558.310254:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3b0ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100175232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727558.310261:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1782727558.310283:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782727558.310308:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3dde0000 x1869325100175232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727558.310345:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dde0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100175232:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1782727558.312289:0:7333:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 282593913103ns, next at 283593909793ns, rc = 0 00010000:00010000:3.0:1782727559.205804:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727559.477190:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727559.477288:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727559.477331:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727559.477418:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080216704 00000100:00100000:3.0:1782727559.477428:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080216704 00000100:00100000:3.0:1782727559.477527:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 98 00000100:00100000:3.0:1782727559.477539:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e14f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+14:2351:x1869325080216704:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1782727559.477625:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e14f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+14:2351:x1869325080216704:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 88us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727559.477632:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 98 00000100:00080000:1.0:1782727559.478074:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727559.479026:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080216832 00000100:00100000:2.0:1782727559.479036:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080216832 00000100:00100000:2.0:1782727559.479153:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 39 00000100:00100000:2.0:1782727559.479163:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae37c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2351:x1869325080216832:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1782727559.479227:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae37c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2351:x1869325080216832:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 66us (1939us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727559.479251:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 39 00000100:00100000:0.0:1782727559.482577:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080216576 00000100:00100000:0.0:1782727559.482596:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080216576 00000100:00100000:0.0:1782727559.482685:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 234 00000100:00100000:0.0:1782727559.482696:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2351:x1869325080216576:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1782727559.482913:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2351:x1869325080216576:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 217us (5733us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727559.482922:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 234 00000100:00080000:1.0:1782727559.486581:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727559.847725:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dfb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100175360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727559.847814:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727559.847906:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100175360 00000100:00100000:2.0:1782727559.847914:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100175360 00000100:00100000:2.0:1782727559.847983:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782727559.847993:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100175360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727559.848023:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727559.848062:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100175360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727559.848070:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1782727559.848110:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3dfb1f80 x1869325100175360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727575 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727559.848129:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dfb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100175360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727559.848363:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dfb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100175872:0@lo:400:kworker.0 00000100:00100000:1.0:1782727559.848414:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727559.848450:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727559.848456:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dfb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325100175744:0@lo:400:kworker.0 00000100:00100000:1.0:1782727559.848481:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727559.848504:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100175872 00000100:00100000:1.0:1782727559.848507:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100175872 00000100:00100000:1.0:1782727559.848533:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782727559.848539:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100175872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727559.848575:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100175872:12345-0@lo:400:kworker.0 Request processed in 36us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727559.848582:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1782727559.848606:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90ae3dfb3480 x1869325100175872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727559.848616:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dfb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100175872:0@lo:400:kworker.0 00000100:00080000:1.0:1782727559.848633:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727559.848765:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dfb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869325100175616:0@lo:400:kworker.0 00000100:00100000:0.0:1782727559.848803:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727559.848831:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782727559.848837:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dfb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100175488:0@lo:400:kworker.0 00000100:00100000:0.0:1782727559.848863:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727559.848884:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dfb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1869325100176000:0@lo:400:kworker.0 00000100:00100000:0.0:1782727559.848904:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727559.848929:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100175488 00000100:00100000:0.0:1782727559.848932:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100175488 00000100:00100000:0.0:1782727559.848959:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1782727559.848965:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3446:x1869325100175488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727559.849011:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3446:x1869325100175488:12345-0@lo:400:kworker.0 Request processed in 46us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727559.849031:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1782727559.849064:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dfb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100175488:0@lo:400:kworker.0 00000100:00100000:0.0:1782727559.849081:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100175744 00000100:00100000:0.0:1782727559.849084:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100175744 00000100:00100000:0.0:1782727559.849112:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100175616 00000100:00100000:0.0:1782727559.849115:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100175616 00000100:00100000:0.0:1782727559.849125:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100176000 00000100:00100000:0.0:1782727559.849127:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100176000 00000100:00100000:0.0:1782727559.849140:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782727559.849145:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325100175744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727559.849177:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325100175744:12345-0@lo:400:kworker.0 Request processed in 31us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727559.849183:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782727559.849194:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782727559.849214:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dde0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869325100175616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727559.849242:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dde0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869325100175616:12345-0@lo:400:kworker.0 Request processed in 29us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727559.849247:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782727559.849258:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782727559.849262:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dde0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869325100176000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727559.849285:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dde0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869325100176000:12345-0@lo:400:kworker.0 Request processed in 23us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727559.849291:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782727559.849314:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dfb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1869325100176000:0@lo:400:kworker.0 00000100:00100000:0.0:1782727559.849324:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dfb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869325100175616:0@lo:400:kworker.0 00000100:00080000:0.0:1782727559.849355:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727559.849574:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dfb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325100175744:0@lo:400:kworker.0 00010000:00010000:0.0:1782727560.229673:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727561.254000:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782727561.901769:0:5931:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1782727561.901804:0:5931:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1782727561.901815:0:5931:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1782727561.903280:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae2a74f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100176128:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782727561.903418:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727561.903518:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100176128 00000100:00100000:3.0:1782727561.903529:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100176128 00000100:00100000:3.0:1782727561.903600:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782727561.903610:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2e721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100176128:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1782727561.903648:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1782727561.903656:0:6941:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1782727561.903692:0:6941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a424383, atime: 0x6a424383, ctime: 0x6a424383, blocks: 0x0 00010000:00010000:3.0:1782727561.903700:0:6941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085f67f15/0x8db73d43f5504bbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727561.903718:0:6941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=286s v=(0 0) 00010000:00010000:3.0:1782727561.903722:0:6941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782727561.903729:0:6941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f67f15/0x8db73d43f5504bbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727561.903754:0:6941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f67f15/0x8db73d43f5504bbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727561.903765:0:6941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085f67f15/0x8db73d43f5504bbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727561.903773:0:6941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085f67f15/0x8db73d43f5504bbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727561.903811:0:6941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782727561.903844:0:5941:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727561.903855:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085f67f15/0x8db73d43f5504bbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727561.903869:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01538e00 already unused, calling callback (ffffffffc0b2bcf0) 00010000:00010000:2.0:1782727561.903890:0:5941:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f67f15/0x8db73d43f5504bbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727561.903903:0:5941:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f67f15/0x8db73d43f5504bbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727561.904000:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2e721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3446:x1869325100176128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 390us (581us total) trans 4294967300 rc 0/0 00010000:00010000:2.0:1782727561.904003:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085f67f15/0x8db73d43f5504bbf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727561.904024:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f67f15/0x8db73d43f5504bbf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727561.904029:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1782727561.904068:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727561.904073:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727561.904077:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782727561.904201:0:3446:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ae2a74f800/2, rc 0, transno 4294967300 00000100:00100000:2.0:1782727561.904210:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae2a74f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100176128:0@lo:6:osp-syn-0-0.0 00000001:02000400:1.0:1782727561.972265:0:12253:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 63b: async write errors should be returned to fsync ============================================================= 06:05:59 (1782727559) 00010000:00010000:0.0:1782727562.279020:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727563.068996:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727563.069098:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080216960 00000100:00100000:1.0:1782727563.069108:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080216960 00000100:00100000:1.0:1782727563.069190:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 31 00000100:00100000:1.0:1782727563.069201:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2a74e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+5:10933:x1869325080216960:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:1.0:1782727563.069221:0:5952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727563.069244:0:5952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6a00/0x8db73d43f5504bc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c397357843 expref: -99 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727563.069310:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504bcd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727563.069323:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727563.069335:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727563.069393:0:5952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782727563.069397:0:5952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782727563.069430:0:5952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727563.069455:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6a00/0x8db73d43f5504bc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357843 expref: 7 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727563.069471:0:5952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504bcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357843 expref: 6 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727563.069479:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae106df300) 00010000:00010000:1.0:1782727563.069495:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782727563.069499:0:5952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae37da6200, rc 0) 00000100:00100000:1.0:1782727563.069564:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2a74e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:10933:x1869325080216960:12345-192.168.204.35@tcp:101:dd.0 Request processed in 365us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727563.069572:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 31 00000100:00080000:2.0:1782727563.069683:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727563.094319:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727563.094495:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080217216 00000100:00100000:0.0:1782727563.094508:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080217216 00000100:00100000:0.0:1782727563.094575:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 32 00000100:00100000:0.0:1782727563.094586:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+6:10933:x1869325080217216:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:0.0:1782727563.094605:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727563.094609:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782727563.094636:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504bcd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357843 expref: 6 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.094651:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae106df300) 00010000:00010000:0.0:1782727563.094662:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727563.094679:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1c00/0x8db73d43f5504bd4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c39735784a expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.094790:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504bdb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.094805:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504bdb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.094814:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504bdb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.096332:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504be2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.096365:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504be2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.099139:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504be2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782727563.099561:0:5954:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1782727563.100188:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0600/0x8db73d43f5504be9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.100205:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0600/0x8db73d43f5504be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.100216:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0600/0x8db73d43f5504be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.100249:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504bdb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.100257:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504bdb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.100264:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504bdb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.100271:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae013a0800 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:0.0:1782727563.100276:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504bdb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.100283:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504bdb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.100307:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3db01300) 00010000:00010000:0.0:1782727563.100311:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727563.100315:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504bdb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.100322:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504bdb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727563.100336:0:5954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000060e7ee0f reply state 00000000580a6e69 transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504be2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727563.100346:0:5954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782727563.100505:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1c00/0x8db73d43f5504bd4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735784a expref: 8 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.100529:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0600/0x8db73d43f5504be9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735784a expref: 7 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.100538:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90ae3db01f00) 00010000:00010000:0.0:1782727563.100540:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782727563.100543:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae013a0600, rc 0) 00000100:00100000:0.0:1782727563.101002:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+8:10933:x1869325080217216:12345-192.168.204.35@tcp:101:dd.0 Request processed in 6416us (6693us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1782727563.101011:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 32 00010000:00010000:3.0:1782727563.106490:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504be2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.106510:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504be2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.106517:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504be2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.106524:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae013a1200 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:3.0:1782727563.106528:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504be2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.106536:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504be2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.106552:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff90ae3db01400) 00010000:00010000:3.0:1782727563.106556:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727563.106559:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504be2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.106565:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504be2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727563.107300:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727563.107366:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080217344 00000100:00100000:3.0:1782727563.107398:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080217344 00000100:00100000:3.0:1782727563.107439:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00100000:3.0:1782727563.107447:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1869325080217344:12345-192.168.204.35@tcp:8:dd.0 00010000:00080000:3.0:1782727563.107479:0:6939:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0001: connection from f875d55c-258d-46bd-8e2e-5a5be22638df@192.168.204.35@tcp t0 exp 0000000000000000 cur 287 last 0 00000020:00000080:3.0:1782727563.107506:0:6939:0:(genops.c:1406:class_connect()) connect: client f875d55c-258d-46bd-8e2e-5a5be22638df, cookie 0x8db73d43f5504bf7 00002000:00100000:3.0:1782727563.107518:0:6939:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f875d55c-258d-46bd-8e2e-5a5be22638df/ffff90ae06b10000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782727563.107579:0:6939:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782727563.107656:0:6939:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782727563.107687:0:6939:0:(import.c:65:import_set_state_nolock()) ffff90ae3b26f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782727563.107762:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2349:x1869325080217344:12345-192.168.204.35@tcp:8:dd.0 Request processed in 314us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727563.107769:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00100000:2.0:1782727563.112186:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727563.112317:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080217472 00000100:00100000:3.0:1782727563.112325:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080217472 00000100:00080000:2.0:1782727563.112559:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727563.112673:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:3.0:1782727563.112684:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+6:10933:x1869325080217472:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:3.0:1782727563.112702:0:6940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727563.112737:0:6940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c228bc9b/0x8db73d43f5504bfe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c397357851 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782727563.112763:0:6940:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782727563.112783:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=287s v=(0 0) 00010000:00010000:3.0:1782727563.112788:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782727563.112804:0:6940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c228bc9b/0x8db73d43f5504bfe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357851 expref: 7 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.112825:0:6940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c228bc9b/0x8db73d43f5504bfe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357851 expref: 7 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.112839:0:6940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae01539800, rc 0) 00000100:00100000:3.0:1782727563.112898:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+7:10933:x1869325080217472:12345-192.168.204.35@tcp:101:dd.0 Request processed in 216us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727563.112968:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:2.0:1782727563.117473:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727563.117568:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080217728 00000100:00100000:3.0:1782727563.117577:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080217728 00000100:00100000:3.0:1782727563.117661:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:3.0:1782727563.117673:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+7:10933:x1869325080217728:12345-192.168.204.35@tcp:35:dd.0 00000100:00100000:3.0:1782727563.118007:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+8:10933:x1869325080217728:12345-192.168.204.35@tcp:35:dd.0 Request processed in 335us (633us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1782727563.118016:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:3.0:1782727563.141709:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727563.142873:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080217856 00000100:00100000:0.0:1782727563.142885:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080217856 00000100:00100000:0.0:1782727563.142945:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 33 00000100:00100000:0.0:1782727563.142955:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2a74f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+8:10934:x1869325080217856:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:0.0:1782727563.142987:0:5952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727563.143010:0:5952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1c00/0x8db73d43f5504c05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c397357858 expref: -99 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.143074:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504c0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.143088:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504c0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.143098:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504c0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727563.143142:0:5952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782727563.143146:0:5952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727563.143165:0:5952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504c0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.143187:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1c00/0x8db73d43f5504c05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357858 expref: 10 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.143203:0:5952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504c0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357858 expref: 9 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.143212:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3db01300) 00010000:00010000:0.0:1782727563.143214:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782727563.143218:0:5952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae013a0800, rc 0) 00000100:00100000:0.0:1782727563.143277:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2a74f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+9:10934:x1869325080217856:12345-192.168.204.35@tcp:101:rm.0 Request processed in 324us (1578us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727563.143285:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 33 00000100:00100000:2.0:1782727563.153326:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727563.153549:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080218112 00000100:00100000:3.0:1782727563.153559:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080218112 00000100:00100000:3.0:1782727563.153625:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 34 00000100:00100000:3.0:1782727563.153636:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+9:10934:x1869325080218112:12345-192.168.204.35@tcp:36:rm.0 00010000:00010000:3.0:1782727563.153692:0:8842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782727563.153731:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0600/0x8db73d43f5504be9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735784a expref: 9 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.153767:0:8842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90ae3db01f00) 00010000:00010000:3.0:1782727563.153788:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504c0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357858 expref: 8 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.153797:0:8842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3db01300) 00010000:00010000:3.0:1782727563.153804:0:8842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727563.153829:0:8842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539a00/0x8db73d43f5504c13 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.153840:0:8842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539a00/0x8db73d43f5504c13 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.153850:0:8842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539a00/0x8db73d43f5504c13 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.153863:0:8842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504c1a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.153870:0:8842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504c1a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.153877:0:8842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504c1a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.153981:0:8842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538400/0x8db73d43f5504c21 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.153990:0:8842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538400/0x8db73d43f5504c21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.154010:0:8842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538400/0x8db73d43f5504c21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782727563.154238:0:8842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1782727563.154248:0:8842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 287435875070ns, next at 288435872903ns, rc = 0 00010000:00010000:3.0:1782727563.154295:0:8842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504c28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.154304:0:8842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.154312:0:8842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.154320:0:8842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504c28 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.154326:0:8842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504c28 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.154332:0:8842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504c28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.154357:0:8842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782727563.155215:0:8842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538400/0x8db73d43f5504c21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.155282:0:8842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538400/0x8db73d43f5504c21 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.155290:0:8842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538400/0x8db73d43f5504c21 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.155305:0:8842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01538400 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:3.0:1782727563.155309:0:8842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538400/0x8db73d43f5504c21 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.155318:0:8842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538400/0x8db73d43f5504c21 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.155330:0:8842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90ae03598c00) 00010000:00010000:3.0:1782727563.155333:0:8842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782727563.155338:0:8842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538400/0x8db73d43f5504c21 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.155344:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538400/0x8db73d43f5504c21 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.155679:0:8842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539a00/0x8db73d43f5504c13 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.155689:0:8842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539a00/0x8db73d43f5504c13 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.155696:0:8842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539a00/0x8db73d43f5504c13 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.155701:0:8842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01539a00 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:3.0:1782727563.155704:0:8842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539a00/0x8db73d43f5504c13 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.155710:0:8842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539a00/0x8db73d43f5504c13 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.155742:0:8842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae03598100) 00010000:00010000:3.0:1782727563.155744:0:8842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727563.155748:0:8842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539a00/0x8db73d43f5504c13 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.155754:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539a00/0x8db73d43f5504c13 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782727563.155772:0:8842:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a9e704fe reply state 00000000d54c48c5 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504c1a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727563.155782:0:8842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782727563.155869:0:5940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727563.155876:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504c28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.155885:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01538800 already unused, calling callback (ffffffffc0b2bcf0) 00010000:00010000:0.0:1782727563.155889:0:5940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504c28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.155896:0:5940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504c28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.155906:0:5940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90ae03598c00) 00010000:00010000:0.0:1782727563.155909:0:5940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782727563.155913:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504c28 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727563.155923:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+9:10934:x1869325080218112:12345-192.168.204.35@tcp:36:rm.0 Request processed in 2283us (2600us total) trans 4294967311 rc 0/0 00010000:00010000:0.0:1782727563.155923:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538800/0x8db73d43f5504c28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.155938:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727563.155941:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727563.155944:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727563.155946:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 34 00010000:00010000:0.0:1782727563.168740:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504c1a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.168847:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504c1a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.168856:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504c1a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.168863:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01538e00 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:0.0:1782727563.168868:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504c1a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.168889:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504c1a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.168908:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff90ae03598800) 00010000:00010000:0.0:1782727563.168911:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727563.168916:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504c1a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.168922:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538e00/0x8db73d43f5504c1a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727563.292773:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727563.292898:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080218240 00000100:00100000:0.0:1782727563.292910:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080218240 00000100:00100000:0.0:1782727563.292979:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 35 00000100:00100000:0.0:1782727563.292989:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+8:10937:x1869325080218240:12345-192.168.204.35@tcp:101:multiop.0 00010000:00010000:0.0:1782727563.293018:0:5952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727563.293041:0:5952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1c00/0x8db73d43f5504c2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c39735785f expref: -99 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.293113:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504c36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.293128:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.293140:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727563.293182:0:5952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782727563.293200:0:5952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727563.293365:0:5952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.293510:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1c00/0x8db73d43f5504c2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735785f expref: 10 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.293530:0:5952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504c36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735785f expref: 9 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.293540:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3db01a00) 00010000:00010000:0.0:1782727563.293543:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782727563.293546:0:5952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae013a0800, rc 0) 00000100:00100000:0.0:1782727563.293609:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+9:10937:x1869325080218240:12345-192.168.204.35@tcp:101:multiop.0 Request processed in 622us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727563.293617:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 35 00000100:00100000:3.0:1782727563.298138:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727563.299625:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080218496 00000100:00100000:0.0:1782727563.299638:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080218496 00000100:00100000:0.0:1782727563.299826:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 36 00000100:00100000:0.0:1782727563.299838:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2a74dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+9:10937:x1869325080218496:12345-192.168.204.35@tcp:101:multiop.0 00010000:00010000:0.0:1782727563.299858:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727563.299861:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782727563.299885:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0800/0x8db73d43f5504c36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735785f expref: 9 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.300318:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3db01a00) 00010000:00010000:0.0:1782727563.300333:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727563.300350:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0600/0x8db73d43f5504c3d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c397357866 expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.300500:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504c44 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.300514:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504c44 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.300524:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504c44 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.300536:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504c4b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.300543:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504c4b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.300551:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504c4b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782727563.301023:0:5954:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1782727563.301165:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030000/0x8db73d43f5504c52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.301175:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030000/0x8db73d43f5504c52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.301183:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030000/0x8db73d43f5504c52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.301619:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504c44 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.301640:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504c44 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.301646:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504c44 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.301653:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae013a0200 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:0.0:1782727563.301658:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504c44 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.301666:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504c44 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.301677:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3db01d00) 00010000:00010000:0.0:1782727563.301680:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727563.301684:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504c44 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.301690:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0200/0x8db73d43f5504c44 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727563.301704:0:5954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000015c6bfc9 reply state 00000000b69e6611 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504c4b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727563.301712:0:5954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782727563.301828:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a0600/0x8db73d43f5504c3d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357866 expref: 11 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.301850:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae00030000/0x8db73d43f5504c52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357866 expref: 10 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.301867:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90ae3db01800) 00010000:00010000:0.0:1782727563.301870:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782727563.301873:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae00030000, rc 0) 00000100:00100000:0.0:1782727563.302056:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2a74dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+11:10937:x1869325080218496:12345-192.168.204.35@tcp:101:multiop.0 Request processed in 2219us (3929us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1782727563.302064:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 36 00010000:00010000:2.0:1782727563.302885:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727563.314496:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504c4b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.314519:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504c4b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.314528:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504c4b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.314534:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae013a1200 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:0.0:1782727563.314539:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504c4b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.314547:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504c4b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.314565:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff90ae3db01900) 00010000:00010000:0.0:1782727563.314568:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727563.314573:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504c4b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.314579:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae013a1200/0x8db73d43f5504c4b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727563.320911:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727563.321058:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080218624 00000100:00100000:3.0:1782727563.321068:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080218624 00000100:00100000:3.0:1782727563.321129:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:3.0:1782727563.321138:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+5:10937:x1869325080218624:12345-192.168.204.35@tcp:101:multiop.0 00010000:00010000:3.0:1782727563.321154:0:6941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727563.321172:0:6941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000882dcb8/0x8db73d43f5504c60 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c39735786d expref: -99 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782727563.321198:0:6941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782727563.321360:0:6941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=287s v=(0 0) 00010000:00010000:3.0:1782727563.321365:0:6941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782727563.321402:0:6941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000882dcb8/0x8db73d43f5504c60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735786d expref: 6 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.321434:0:6941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000882dcb8/0x8db73d43f5504c60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735786d expref: 6 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.321447:0:6941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae01539a00, rc 0) 00000100:00100000:3.0:1782727563.321496:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+6:10937:x1869325080218624:12345-192.168.204.35@tcp:101:multiop.0 Request processed in 359us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727563.321503:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00080000:2.0:1782727563.321941:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727563.346480:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727563.346549:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080218752 00000100:00100000:0.0:1782727563.346572:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080218752 00000100:00100000:0.0:1782727563.346637:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 37 00000100:00100000:0.0:1782727563.346648:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2a74d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+10:10937:x1869325080218752:12345-192.168.204.35@tcp:44:multiop.0 00000001:00080000:3.0:1782727563.348144:0:5931:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967312 is committed 00000004:00080000:3.0:1782727563.348159:0:5931:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1782727563.348547:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727563.348804:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2a74d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+6:10937:x1869325080218752:12345-192.168.204.35@tcp:44:multiop.0 Request processed in 2152us (2331us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727563.348805:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100176256:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782727563.348820:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 37 00000100:00100000:1.0:1782727563.348863:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727563.351454:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100176256 00000100:00100000:3.0:1782727563.351470:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100176256 00000100:00100000:3.0:1782727563.351557:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782727563.351566:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100176256:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782727563.351598:0:6940:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00010000:00010000:3.0:1782727563.351623:0:6940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daed494d/0x8db73d43f5504c67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.351645:0:6940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c228bc9b/0x8db73d43f5504bfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357851 expref: 6 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.351654:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782727563.351658:0:6940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782727563.351662:0:6940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daed494d/0x8db73d43f5504c67 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782727563.351873:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782727563.351988:0:6940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c228bc9b/0x8db73d43f5504bfe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.204.35@tcp remote: 0x9cd528c397357851 expref: 6 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.352002:0:6940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c228bc9b/0x8db73d43f5504bfe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.204.35@tcp remote: 0x9cd528c397357851 expref: 6 pid: 6940 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727563.352017:0:6940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae2a74ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6940:1869325100176384:192.168.204.35@tcp:104: 00000100:00100000:3.0:1782727563.352107:0:6940:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3e1593c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727563.353989:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727563.354127:0:6939:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1782727563.354136:0:6939:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1782727563.354408:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080218880 00000100:00100000:1.0:1782727563.354416:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080218880 00000100:00100000:3.0:1782727563.354571:0:12314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 19 00000100:00100000:3.0:1782727563.354581:0:12314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2351:x1869325080218880:12345-192.168.204.35@tcp:16:multiop.0 00000100:00100000:3.0:1782727563.354812:0:12314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2351:x1869325080218880:12345-192.168.204.35@tcp:16:multiop.0 Request processed in 231us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727563.354820:0:12314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 19 00000100:00100000:2.0:1782727563.362082:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727563.362201:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080219136 00000100:00100000:1.0:1782727563.362210:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080219136 00000100:00100000:1.0:1782727563.362273:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:1.0:1782727563.362284:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:10937:x1869325080219136:12345-192.168.204.35@tcp:35:multiop.0 00000100:00100000:1.0:1782727563.362630:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+7:10937:x1869325080219136:12345-192.168.204.35@tcp:35:multiop.0 Request processed in 347us (558us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1782727563.362638:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:3.0:1782727563.363054:0:6940:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae2a74ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6940:1869325100176384:192.168.204.35@tcp:104: 00010000:00010000:3.0:1782727563.363080:0:6940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000daed494d/0x8db73d43f5504c67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727563.372276:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727563.372469:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080219264 00000100:00100000:3.0:1782727563.372478:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080219264 00010000:00010000:3.0:1782727563.372518:0:5938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c228bc9b/0x8db73d43f5504bfe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.204.35@tcp remote: 0x9cd528c397357851 expref: 7 pid: 6940 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727563.372585:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 29 00000100:00100000:3.0:1782727563.372595:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dde2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+7:2351:x1869325080219264:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782727563.372613:0:5938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727563.372619:0:5938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c228bc9b/0x8db73d43f5504bfe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.204.35@tcp remote: 0x9cd528c397357851 expref: 7 pid: 6940 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.372631:0:5938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c228bc9b/0x8db73d43f5504bfe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.204.35@tcp remote: 0x9cd528c397357851 expref: 7 pid: 6940 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.372652:0:5938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c228bc9b/0x8db73d43f5504bfe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.204.35@tcp remote: 0x9cd528c397357851 expref: 7 pid: 6940 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.372669:0:5938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782727563.372673:0:5938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782727563.372679:0:5938:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000daed494d/0x8db73d43f5504c67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.372689:0:5938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daed494d/0x8db73d43f5504c67 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727563.372744:0:5938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727563.372805:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dde2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2351:x1869325080219264:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 210us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727563.372813:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 29 00010000:00010000:1.0:1782727563.373314:0:6940:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000daed494d/0x8db73d43f5504c67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727563.373326:0:6940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daed494d/0x8db73d43f5504c67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727563.373337:0:6940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daed494d/0x8db73d43f5504c67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727563.373359:0:6940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000daed494d/0x8db73d43f5504c67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727563.373422:0:6940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782727563.373667:0:8017:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727563.373674:0:8017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000daed494d/0x8db73d43f5504c67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.373683:0:8017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae01538400 already unused, calling callback (ffffffffc0b2bcf0) 00010000:00010000:0.0:1782727563.373687:0:8017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000daed494d/0x8db73d43f5504c67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.373696:0:8017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000daed494d/0x8db73d43f5504c67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.373712:0:8017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000daed494d/0x8db73d43f5504c67 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.373730:0:8017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daed494d/0x8db73d43f5504c67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727563.373763:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727563.373765:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727563.373767:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727563.373985:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3444:x1869325100176256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22418us (25119us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1782727563.373994:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1782727563.375852:0:3444:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ae3df87800/2, rc 0, transno 4294967299 00000100:00100000:2.0:1782727563.375868:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100176256:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782727563.431369:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dde2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100176512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727563.431465:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727563.431645:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100176512 00000100:00100000:1.0:1782727563.431655:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100176512 00000100:00100000:1.0:1782727563.431737:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782727563.431747:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3444:x1869325100176512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782727563.431786:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00080000:3.0:1782727563.433291:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727563.433697:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3444:x1869325100176512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1934us (2215us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727563.433710:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782727563.433966:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dde2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100176512:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782727564.325888:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727564.592599:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727564.592684:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080219392 00000100:00100000:3.0:1782727564.592703:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080219392 00000100:00100000:3.0:1782727564.592853:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 236 00000100:00100000:3.0:1782727564.592865:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2352:x1869325080219392:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1782727564.592951:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2352:x1869325080219392:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 89us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727564.592960:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 236 00000100:00100000:0.0:1782727564.598821:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727564.598938:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727564.608531:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080219776 00000100:00100000:1.0:1782727564.608548:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080219776 00000100:00100000:0.0:1782727564.608839:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727564.608915:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080219520 00000100:00100000:0.0:1782727564.608919:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080219520 00000100:00100000:0.0:1782727564.608952:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 102 00000100:00100000:0.0:1782727564.608963:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dde0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+7:2352:x1869325080219520:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1782727564.608977:0:12314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080219648 00000100:00100000:3.0:1782727564.608994:0:12314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080219648 00000100:00100000:1.0:1782727564.609026:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 41 00000100:00100000:1.0:1782727564.609040:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dde3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2353:x1869325080219776:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1782727564.609052:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dde0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+7:2352:x1869325080219520:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 88us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727564.609061:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 102 00000100:00100000:1.0:1782727564.609084:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dde3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2353:x1869325080219776:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 45us (10274us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727564.609093:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 41 00000100:00100000:1.0:1782727564.609110:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 42 00000100:00100000:1.0:1782727564.609118:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dde2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2353:x1869325080219648:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1782727564.609167:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dde2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2353:x1869325080219648:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 50us (10230us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727564.609174:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 42 00000100:00100000:2.0:1782727564.965648:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dfb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100176640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727564.965738:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727564.965835:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100176640 00000100:00100000:3.0:1782727564.965845:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100176640 00000100:00100000:3.0:1782727564.965898:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782727564.965907:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3445:x1869325100176640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727564.965935:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727564.966000:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3445:x1869325100176640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727564.966007:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782727564.966050:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dfb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100176640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727564.966260:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e09ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100177152:0@lo:400:kworker.0 00000100:00100000:3.0:1782727564.966279:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dde3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100176768:0@lo:400:kworker.0 00000100:00100000:2.0:1782727564.966297:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727564.966315:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727564.966348:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e09e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1869325100177280:0@lo:400:kworker.0 00000100:00100000:2.0:1782727564.966358:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dde1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325100177024:0@lo:400:kworker.0 00000100:00100000:3.0:1782727564.966403:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727564.966448:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100176768 00000100:00100000:2.0:1782727564.966454:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100176768 00000100:00100000:0.0:1782727564.966466:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100177152 00000100:00100000:0.0:1782727564.966472:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100177152 00000100:00100000:2.0:1782727564.966491:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1782727564.966501:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3446:x1869325100176768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727564.966504:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782727564.966516:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3445:x1869325100177152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727564.966560:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3445:x1869325100177152:12345-0@lo:400:kworker.0 Request processed in 47us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727564.966567:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782727564.966592:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dde2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325100176896:0@lo:400:kworker.0 00000100:00100000:0.0:1782727564.966600:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e09ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100177152:0@lo:400:kworker.0 00000100:00100000:0.0:1782727564.966624:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100177280 00000100:00100000:1.0:1782727564.966629:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727564.966629:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100177280 00000100:00100000:1.0:1782727564.966666:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100176896 00000100:00100000:1.0:1782727564.966670:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100176896 00000100:00100000:1.0:1782727564.966715:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782727564.966722:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325100176896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727564.966758:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325100176896:12345-0@lo:400:kworker.0 Request processed in 36us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727564.966764:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782727564.966792:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dde2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325100176896:0@lo:400:kworker.0 00000100:00100000:3.0:1782727564.970470:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727564.971013:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3446:x1869325100176768:12345-0@lo:400:kworker.0 Request processed in 4510us (4693us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727564.971026:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1782727564.973244:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100177024 00000100:00100000:1.0:1782727564.973259:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100177024 00000100:00100000:0.0:1782727564.973414:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782727564.973425:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2a74ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869325100177280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727564.973516:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2a74ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1869325100177280:12345-0@lo:400:kworker.0 Request processed in 94us (7113us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727564.973523:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782727564.978720:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1782727564.978737:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2a74c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325100177024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727564.979152:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2a74c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325100177024:12345-0@lo:400:kworker.0 Request processed in 418us (8690us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727564.979159:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1782727564.979226:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dde3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0332f07-5c7b-4a87-aafc-b3671573fb48:3446:1869325100176768:0@lo:400:kworker.0 00000100:00100000:1.0:1782727564.979243:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e09e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1869325100177280:0@lo:400:kworker.0 00000100:00100000:2.0:1782727564.979349:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dde1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325100177024:0@lo:400:kworker.0 00000100:00080000:3.0:1782727564.979424:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782727565.349580:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727566.373826:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727567.399846:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782727567.543732:0:6933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:2.0:1782727568.392960:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727568.393369:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080219904 00000100:00100000:1.0:1782727568.393423:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080219904 00000100:00100000:1.0:1782727568.393501:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 38 00000100:00100000:1.0:1782727568.393511:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+7:11175:x1869325080219904:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1782727568.393531:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727568.393556:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7c00/0x8db73d43f5504c6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c397357874 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727568.393639:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7600/0x8db73d43f5504c75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727568.393654:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7600/0x8db73d43f5504c75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727568.393667:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7600/0x8db73d43f5504c75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727568.393728:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782727568.393731:0:5953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782727568.393765:0:5953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7600/0x8db73d43f5504c75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727568.393790:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7c00/0x8db73d43f5504c6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357874 expref: 9 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727568.393930:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7600/0x8db73d43f5504c75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357874 expref: 8 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727568.393941:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae106df100) 00010000:00010000:1.0:1782727568.393944:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782727568.393962:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae37da7600, rc 0) 00000100:00100000:1.0:1782727568.394035:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+8:11175:x1869325080219904:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 525us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727568.394044:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 38 00000100:00080000:3.0:1782727568.394144:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727568.400194:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727568.400422:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080220032 00000100:00100000:1.0:1782727568.400433:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080220032 00000100:00100000:1.0:1782727568.400503:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 39 00000100:00100000:1.0:1782727568.400515:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e09ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+8:11175:x1869325080220032:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:1.0:1782727568.400558:0:8842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:1.0:1782727568.400655:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e09ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+8:11175:x1869325080220032:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 141us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727568.400663:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 39 00000100:00100000:2.0:1782727568.412488:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727568.412940:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080220160 00000100:00100000:1.0:1782727568.412951:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080220160 00000100:00100000:1.0:1782727568.413035:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00100000:1.0:1782727568.413047:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f875d55c-258d-46bd-8e2e-5a5be22638df+6:11175:x1869325080220160:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:1.0:1782727568.413082:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727568.413168:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f875d55c-258d-46bd-8e2e-5a5be22638df+6:11175:x1869325080220160:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 124us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727568.413176:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00080000:3.0:1782727568.417248:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727568.419213:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727568.419323:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080220288 00000100:00100000:1.0:1782727568.419334:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080220288 00000100:00100000:1.0:1782727568.419432:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 53 00000100:00100000:1.0:1782727568.419443:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f875d55c-258d-46bd-8e2e-5a5be22638df+6:11175:x1869325080220288:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:1.0:1782727568.419476:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727568.419573:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f875d55c-258d-46bd-8e2e-5a5be22638df+6:11175:x1869325080220288:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 132us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727568.419587:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 53 00000100:00080000:3.0:1782727568.419655:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782727568.421637:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727568.550399:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727568.550433:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e09fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100177408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727568.550504:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727568.551026:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100177408 00000100:00100000:1.0:1782727568.551035:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100177408 00000100:00100000:1.0:1782727568.551100:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782727568.551109:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100177408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782727568.551133:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727568.551181:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100177408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727568.551187:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1782727568.551285:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727568.551427:0:3444:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1782727568.551433:0:3444:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ae2a74f800, transno 4294967300 00000100:00100000:0.0:1782727568.551569:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e09fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100177408:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1782727568.554459:0:5931:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967313 is committed 00000001:00080000:3.0:1782727568.561316:0:8009:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1782727568.561334:0:8009:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f875d55c-258d-46bd-8e2e-5a5be22638df 00010000:00010000:3.0:1782727569.452993:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727569.709273:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727569.709314:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727569.709343:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727569.709388:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727569.709417:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080220416 00000100:00100000:3.0:1782727569.709425:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080220416 00000100:00100000:3.0:1782727569.709476:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 238 00000100:00100000:3.0:1782727569.709486:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2352:x1869325080220416:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1782727569.709568:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2352:x1869325080220416:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 83us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727569.709575:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 238 00000100:00100000:3.0:1782727569.709618:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080220672 00000100:00100000:3.0:1782727569.709622:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080220672 00000100:00100000:3.0:1782727569.709646:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080220800 00000100:00100000:3.0:1782727569.709649:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080220800 00000100:00100000:3.0:1782727569.709668:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 44 00000100:00100000:3.0:1782727569.709673:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2a74f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2352:x1869325080220672:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1782727569.709705:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2a74f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2352:x1869325080220672:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 31us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727569.709711:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 44 00000100:00100000:3.0:1782727569.709722:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 45 00000100:00100000:3.0:1782727569.709729:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2a74ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2352:x1869325080220800:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1782727569.709775:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2a74ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2352:x1869325080220800:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 46us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727569.709781:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 45 00000100:00100000:1.0:1782727569.713078:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080220544 00000100:00100000:1.0:1782727569.713094:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080220544 00000100:00100000:1.0:1782727569.713176:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 106 00000100:00100000:1.0:1782727569.713186:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2a74f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+7:2352:x1869325080220544:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1782727569.713258:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2a74f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+7:2352:x1869325080220544:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 72us (3913us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727569.713265:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 106 00000100:00100000:1.0:1782727570.085646:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dfb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3446:1869325100177792:0@lo:400:kworker.0 00000100:00100000:1.0:1782727570.085729:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727570.085805:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782727570.085811:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dfb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869325100177664:0@lo:400:kworker.0 00000100:00100000:1.0:1782727570.085836:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727570.085851:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dfb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100178176:0@lo:400:kworker.0 00000100:00100000:1.0:1782727570.085888:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727570.085924:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100177792 00000100:00100000:1.0:1782727570.085932:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100177792 00000100:00100000:1.0:1782727570.086001:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100177664 00000100:00100000:1.0:1782727570.086005:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100177664 00000100:00100000:1.0:1782727570.086023:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782727570.086030:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869325100177792:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782727570.086052:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727570.086064:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100178176 00000100:00100000:3.0:1782727570.086067:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100178176 00000100:00100000:1.0:1782727570.086079:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1869325100177792:12345-0@lo:400:kworker.0 Request processed in 49us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727570.086086:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782727570.086097:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782727570.086102:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782727570.086103:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100178176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727570.086106:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869325100177664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727570.086131:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869325100177664:12345-0@lo:400:kworker.0 Request processed in 24us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727570.086132:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100178176:12345-0@lo:400:kworker.0 Request processed in 30us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727570.086138:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782727570.086138:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1782727570.086154:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782727570.086177:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dfb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869325100177664:0@lo:400:kworker.0 00000100:00100000:1.0:1782727570.086187:0:3446:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000004:00080000:1.0:1782727570.086192:0:3446:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ae3df87800, transno 4294967299 00000100:00100000:1.0:1782727570.086210:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dfb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100178176:0@lo:400:kworker.0 00000100:00100000:1.0:1782727570.086220:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dfb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3446:1869325100177792:0@lo:400:kworker.0 00000100:00100000:0.0:1782727570.086474:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dfb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0332f07-5c7b-4a87-aafc-b3671573fb48:3444:1869325100177536:0@lo:400:kworker.0 00000100:00100000:0.0:1782727570.086510:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727570.086533:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dfb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3444:1869325100178048:0@lo:400:kworker.0 00000100:00100000:0.0:1782727570.086556:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727570.086642:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dfb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100177920:0@lo:400:kworker.0 00000100:00100000:2.0:1782727570.086672:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727570.086703:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100177536 00000100:00100000:2.0:1782727570.086707:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100177536 00000100:00100000:2.0:1782727570.086734:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1782727570.086741:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3444:x1869325100177536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727570.086772:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3444:x1869325100177536:12345-0@lo:400:kworker.0 Request processed in 32us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727570.086778:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1782727570.088282:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100177920 00000100:00100000:3.0:1782727570.088293:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100177920 00000100:00100000:3.0:1782727570.088351:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782727570.088361:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100177920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727570.088456:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100177920:12345-0@lo:400:kworker.0 Request processed in 97us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727570.088464:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782727570.088508:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dfb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100177920:0@lo:400:kworker.0 00000100:00080000:2.0:1782727570.090661:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727570.090780:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dfb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100178304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727570.090845:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727570.091398:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dfb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0332f07-5c7b-4a87-aafc-b3671573fb48:3444:1869325100177536:0@lo:400:kworker.0 00000100:00100000:0.0:1782727570.091434:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100178048 00000100:00100000:0.0:1782727570.091440:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100178048 00000100:00100000:0.0:1782727570.091496:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782727570.091506:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e09fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869325100178048:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782727570.091806:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727570.091900:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100178304 00000100:00100000:3.0:1782727570.091904:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100178304 00000100:00100000:1.0:1782727570.091911:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dfb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3444:1869325100178048:0@lo:400:kworker.0 00000100:00100000:3.0:1782727570.091936:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782727570.091943:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100178304:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727570.092765:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e09fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1869325100178048:12345-0@lo:400:kworker.0 Request processed in 59us (5005us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727570.092776:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00002000:00000024:3.0:1782727570.092957:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1782727570.093924:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100178304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1976us (3073us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727570.093934:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782727570.096032:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dfb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100178304:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782727570.473565:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727571.496828:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727572.521715:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727573.542093:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727573.669767:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782727573.669795:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e09d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100178432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727573.669872:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727573.670902:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100178432 00000100:00100000:2.0:1782727573.670913:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100178432 00000100:00100000:2.0:1782727573.670992:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782727573.671002:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100178432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782727573.671034:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1782727573.671104:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100178432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727573.671112:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782727573.671221:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e09d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100178432:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782727573.671403:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727574.486102:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727574.486202:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080220928 00000100:00100000:1.0:1782727574.486213:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080220928 00000100:00100000:1.0:1782727574.486313:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 40 00000100:00100000:1.0:1782727574.486324:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e09d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+7:11601:x1869325080220928:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:1.0:1782727574.486344:0:5952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727574.486565:0:5952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7200/0x8db73d43f5504c7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c39735787b expref: -99 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486637:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504c83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486652:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504c83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486666:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504c83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486682:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504c8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486689:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486695:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486825:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504c83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486833:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504c83 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486840:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504c83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486858:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae37da6e00 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:1.0:1782727574.486862:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504c83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486869:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504c83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486881:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae106df100) 00010000:00010000:1.0:1782727574.486885:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727574.486890:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504c83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486896:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504c83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486912:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486918:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504c8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486924:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504c8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486929:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae37da6200 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:1.0:1782727574.486931:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504c8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486936:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504c8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486954:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd1ea4b6 (ffff90ae106df000) 00010000:00010000:1.0:1782727574.486956:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727574.486959:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504c8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486964:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504c8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.486999:0:5952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7200/0x8db73d43f5504c7c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735787b expref: 8 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.487007:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae106df100) 00010000:00010000:1.0:1782727574.487009:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782727574.487013:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7200/0x8db73d43f5504c7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735787b expref: 8 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727574.487022:0:5952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae37da7200, rc 0) 00000100:00080000:3.0:1782727574.487174:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727574.487229:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e09d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+7:11601:x1869325080220928:12345-192.168.204.35@tcp:101:rm.0 Request processed in 905us (1139us total) trans 0 rc 301/301 00000100:00100000:1.0:1782727574.487237:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 40 00010000:00010000:0.0:1782727574.571805:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727574.832120:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727574.832173:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727574.832296:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080221056 00000100:00100000:0.0:1782727574.832307:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080221056 00000100:00100000:0.0:1782727574.832413:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 240 00000100:00100000:0.0:1782727574.832423:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2350:x1869325080221056:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1782727574.832513:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2350:x1869325080221056:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 92us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727574.832522:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 240 00000100:00100000:3.0:1782727574.833118:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727574.833156:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727574.833202:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080221184 00000100:00100000:0.0:1782727574.833207:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080221184 00000100:00100000:0.0:1782727574.833241:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 110 00000100:00100000:0.0:1782727574.833248:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2a74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+7:2350:x1869325080221184:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1782727574.833290:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2a74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+7:2350:x1869325080221184:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 42us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727574.833296:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 110 00000100:00100000:1.0:1782727574.836558:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080221312 00000100:00100000:1.0:1782727574.836575:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080221312 00000100:00100000:1.0:1782727574.836717:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080221440 00000100:00100000:1.0:1782727574.836722:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080221440 00000100:00080000:3.0:1782727574.836772:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782727574.836777:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727574.836908:0:12314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 48 00000100:00100000:2.0:1782727574.836921:0:12314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2a74d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2350:x1869325080221312:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1782727574.837014:0:12314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2a74d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2350:x1869325080221312:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 96us (4840us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727574.837051:0:12314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 48 00000100:00100000:2.0:1782727574.837071:0:12314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 49 00000100:00100000:2.0:1782727574.837078:0:12314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2a74c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2350:x1869325080221440:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1782727574.837106:0:12314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2a74c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+5:2350:x1869325080221440:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 29us (3949us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727574.837112:0:12314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 49 00000100:00100000:3.0:1782727575.207749:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727575.207772:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dfb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100178560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727575.207843:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727575.208685:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e09e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869325100178816:0@lo:400:kworker.0 00000100:00100000:0.0:1782727575.208691:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e09dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100179072:0@lo:400:kworker.0 00000100:00100000:3.0:1782727575.208739:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727575.208740:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727575.208792:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e09f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100178688:0@lo:400:kworker.0 00000100:00100000:1.0:1782727575.208867:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100178560 00000100:00100000:1.0:1782727575.208877:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100178560 00000100:00100000:1.0:1782727575.208939:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782727575.208949:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2a74ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100178560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727575.208998:0:6943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1782727575.218399:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727575.218422:0:3444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e09f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325100178944:0@lo:400:kworker.0 00000100:00100000:0.0:1782727575.218620:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727575.218805:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100179072 00000100:00100000:0.0:1782727575.218814:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100179072 00000100:00100000:0.0:1782727575.218893:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782727575.218905:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100179072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727575.218986:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1869325100179072:12345-0@lo:400:kworker.0 Request processed in 84us (10248us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727575.218992:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782727575.219055:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e09dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1869325100179072:0@lo:400:kworker.0 00000100:00080000:0.0:1782727575.219184:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782727575.219189:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727575.219204:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100178816 00000100:00100000:0.0:1782727575.219209:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100178816 00000100:00100000:0.0:1782727575.219237:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100178944 00000100:00100000:0.0:1782727575.219240:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100178944 00000100:00100000:0.0:1782727575.219259:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782727575.219264:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2a74ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869325100178816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727575.219299:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2a74ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1869325100178816:12345-0@lo:400:kworker.0 Request processed in 35us (10564us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727575.219305:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782727575.219317:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782727575.219323:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e09c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325100178944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727575.219353:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e09c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1869325100178944:12345-0@lo:400:kworker.0 Request processed in 30us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727575.219359:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1782727575.219393:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727575.219415:0:3444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e09f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1869325100178944:0@lo:400:kworker.0 00000100:00100000:3.0:1782727575.221127:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e09e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1869325100178816:0@lo:400:kworker.0 00000100:00100000:2.0:1782727575.221297:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727575.221341:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e09d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325100179200:0@lo:400:kworker.0 00000100:00100000:3.0:1782727575.221456:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100178688 00000100:00100000:3.0:1782727575.221463:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100178688 00000100:00100000:2.0:1782727575.221729:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727575.221859:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2a74ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100178560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 12910us (14013us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727575.221872:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1782727575.221873:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782727575.221886:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3445:x1869325100178688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727575.221940:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3445:x1869325100178688:12345-0@lo:400:kworker.0 Request processed in 58us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727575.221949:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1782727575.221964:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e09f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0332f07-5c7b-4a87-aafc-b3671573fb48:3445:1869325100178688:0@lo:400:kworker.0 00000100:00100000:2.0:1782727575.222054:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dfb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100178560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727575.222099:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100179200 00000100:00100000:0.0:1782727575.222104:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100179200 00000100:00100000:1.0:1782727575.223010:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782727575.223019:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325100179200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727575.223093:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1869325100179200:12345-0@lo:400:kworker.0 Request processed in 75us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727575.223099:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1782727575.223861:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e09d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1869325100179200:0@lo:400:kworker.0 00000100:00080000:0.0:1782727575.224031:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727575.590548:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727576.613632:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782727576.834016:0:12596:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 118c: Fsync blocks on EROFS until dirty pages are flushed ==================================================================== 06:06:14 (1782727574) 00000100:00100000:0.0:1782727577.433615:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727577.433797:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080221696 00000100:00100000:2.0:1782727577.433808:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080221696 00000100:00100000:2.0:1782727577.433902:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 41 00000100:00100000:2.0:1782727577.433914:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e09f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+7:11851:x1869325080221696:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1782727577.433934:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727577.433937:0:5953:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782727577.433976:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7600/0x8db73d43f5504c75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357874 expref: 7 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.433998:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae106df100) 00010000:00010000:2.0:1782727577.434009:0:5953:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782727577.434026:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9800/0x8db73d43f5504c91 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c397357882 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.434166:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8c00/0x8db73d43f5504c98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.434180:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8c00/0x8db73d43f5504c98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.434189:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8c00/0x8db73d43f5504c98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782727577.436805:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782727577.438173:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9200/0x8db73d43f5504c9f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.438198:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9200/0x8db73d43f5504c9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.438210:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9200/0x8db73d43f5504c9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.438745:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504ca6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.438758:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.438766:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727577.438778:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00010000:00010000:2.0:1782727577.438803:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8c00/0x8db73d43f5504c98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.438810:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8c00/0x8db73d43f5504c98 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.438832:0:5953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8c00/0x8db73d43f5504c98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.438838:0:5953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae033b8c00 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:2.0:1782727577.438841:0:5953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8c00/0x8db73d43f5504c98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.438849:0:5953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8c00/0x8db73d43f5504c98 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.438861:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3b217400) 00010000:00010000:2.0:1782727577.438864:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727577.438868:0:5953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8c00/0x8db73d43f5504c98 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.438874:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8c00/0x8db73d43f5504c98 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782727577.438903:0:5953:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000034bc2568 reply state 00000000b42fbc76 transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9200/0x8db73d43f5504c9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727577.438913:0:5953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782727577.438949:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9800/0x8db73d43f5504c91 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357882 expref: 9 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.439419:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357882 expref: 8 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.439429:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff90ae3b217b00) 00010000:00010000:2.0:1782727577.439431:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782727577.439698:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae033b9600, rc 0) 00000100:00100000:2.0:1782727577.439788:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e09f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+9:11851:x1869325080221696:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 5874us (6183us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1782727577.439798:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 41 00010000:00010000:0.0:1782727577.443528:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9200/0x8db73d43f5504c9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727577.443558:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9200/0x8db73d43f5504c9f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727577.443566:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9200/0x8db73d43f5504c9f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727577.443573:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae033b9200 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:0.0:1782727577.443578:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9200/0x8db73d43f5504c9f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727577.443586:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9200/0x8db73d43f5504c9f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727577.443603:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff90ae3b217900) 00010000:00010000:0.0:1782727577.443606:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727577.443612:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9200/0x8db73d43f5504c9f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727577.443617:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9200/0x8db73d43f5504c9f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727577.450230:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727577.450673:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080221952 00000100:00100000:1.0:1782727577.450685:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080221952 00000100:00100000:1.0:1782727577.450751:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 42 00000100:00100000:1.0:1782727577.450761:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e09dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+8:11851:x1869325080221952:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1782727577.450786:0:5952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727577.450808:0:5952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7200/0x8db73d43f5504cb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c397357889 expref: -99 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.450939:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504cbb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.450955:0:5952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504ca6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357882 expref: 9 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.451060:0:5952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504cbb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.451097:0:5952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x9cd528c397357882 expref: 9 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.451111:0:5952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504ca6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c397357882 expref: 9 pid: 5953 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727577.451125:0:5952:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dfb0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5952:1869325100179328:192.168.204.35@tcp:104: 00000100:00100000:1.0:1782727577.451295:0:5952:0:(client.c:2701:ptlrpc_set_wait()) set ffff90ae3dff49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727577.456278:0:5952:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dfb0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5952:1869325100179328:192.168.204.35@tcp:104: 00010000:00010000:1.0:1782727577.456321:0:5952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504cbb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727577.460176:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727577.460796:0:8881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080222080 00000100:00100000:3.0:1782727577.460807:0:8881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080222080 00010000:00010000:3.0:1782727577.460860:0:8881:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504ca6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c397357882 expref: 10 pid: 5953 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727577.461070:0:8881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 30 00000100:00100000:3.0:1782727577.461081:0:8881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e09f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+10:2350:x1869325080222080:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782727577.461096:0:8881:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727577.461103:0:8881:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504ca6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c397357882 expref: 10 pid: 5953 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727577.461117:0:8881:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c397357882 expref: 10 pid: 5953 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727577.461138:0:8881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9600/0x8db73d43f5504ca6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x9cd528c397357882 expref: 10 pid: 5953 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727577.461155:0:8881:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff90ae3b217b00) 00010000:00010000:3.0:1782727577.461160:0:8881:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504cbb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727577.461169:0:8881:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504cbb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727577.461175:0:8881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504cbb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727577.461213:0:8881:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727577.461278:0:8881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e09f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+9:2350:x1869325080222080:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 198us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727577.461293:0:8881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 30 00010000:00010000:2.0:1782727577.461367:0:5952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504cbb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.461421:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504cbb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727577.461451:0:5952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00000004:00080000:2.0:1782727577.462554:0:5952:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00000004:00080000:2.0:1782727577.462572:0:5952:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1782727577.462705:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504cbb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.462715:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504cbb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.462722:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504cbb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.462728:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae37da6200 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:2.0:1782727577.462732:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504cbb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.462740:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504cbb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.462754:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff90ae3b217b00) 00010000:00010000:2.0:1782727577.462757:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782727577.462771:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504cbb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.462777:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6200/0x8db73d43f5504cbb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.462834:0:5952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7200/0x8db73d43f5504cb4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357889 expref: 9 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.462843:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae106dfd00) 00010000:00010000:2.0:1782727577.462845:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782727577.462849:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7200/0x8db73d43f5504cb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357889 expref: 9 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.462862:0:5952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae37da7200, rc 0) 00000100:00100000:2.0:1782727577.462930:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e09dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+8:11851:x1869325080221952:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 12171us (12717us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1782727577.462939:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 42 00000100:00100000:0.0:1782727577.469837:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727577.470076:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080222336 00000100:00100000:2.0:1782727577.470087:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080222336 00000100:00100000:2.0:1782727577.470192:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:2.0:1782727577.470203:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e09ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+8:11851:x1869325080222336:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:2.0:1782727577.470615:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e09ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+9:11851:x1869325080222336:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 412us (791us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1782727577.470633:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:0.0:1782727577.477219:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727577.477589:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080222464 00000100:00100000:1.0:1782727577.477600:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080222464 00000100:00100000:1.0:1782727577.477673:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 43 00000100:00100000:1.0:1782727577.477683:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e09d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+9:11851:x1869325080222464:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1782727577.477709:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727577.477733:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504cc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c397357890 expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.477792:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504cc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357890 expref: 10 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.477829:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504cc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357890 expref: 10 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.477850:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff90ae106dfa00) 00010000:00010000:1.0:1782727577.477853:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782727577.477857:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae37da6e00, rc 0) 00000100:00100000:1.0:1782727577.477922:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e09d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+10:11851:x1869325080222464:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 241us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727577.477928:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 43 00000100:00100000:0.0:1782727577.484997:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727577.485246:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080222720 00000100:00100000:1.0:1782727577.485257:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080222720 00000100:00100000:1.0:1782727577.485332:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:1.0:1782727577.485343:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+10:11851:x1869325080222720:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:1.0:1782727577.485834:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+11:11851:x1869325080222720:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 490us (849us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1782727577.485843:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:0.0:1782727577.502178:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727577.502433:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080222848 00000100:00100000:2.0:1782727577.502454:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080222848 00000100:00100000:2.0:1782727577.502522:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 44 00000100:00100000:2.0:1782727577.502542:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e09c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+11:11852:x1869325080222848:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1782727577.502583:0:8842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727577.502611:0:8842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9800/0x8db73d43f5504cd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c397357897 expref: -99 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.503405:0:8842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8c00/0x8db73d43f5504cd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.503430:0:8842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8c00/0x8db73d43f5504cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.503451:0:8842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8c00/0x8db73d43f5504cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727577.503498:0:8842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782727577.503502:0:8842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727577.503525:0:8842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8c00/0x8db73d43f5504cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.503551:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9800/0x8db73d43f5504cd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357897 expref: 13 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.503570:0:8842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8c00/0x8db73d43f5504cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357897 expref: 12 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.503579:0:8842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3b217b00) 00010000:00010000:2.0:1782727577.503582:0:8842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782727577.503585:0:8842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae033b8c00, rc 0) 00000100:00100000:2.0:1782727577.503661:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e09c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+12:11852:x1869325080222848:12345-192.168.204.35@tcp:101:dd.0 Request processed in 1130us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727577.503671:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 44 00000100:00100000:0.0:1782727577.511853:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727577.512401:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080223104 00000100:00100000:1.0:1782727577.512494:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080223104 00000100:00100000:1.0:1782727577.512634:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 45 00000100:00100000:1.0:1782727577.512645:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+12:11852:x1869325080223104:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:1.0:1782727577.512667:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727577.512670:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782727577.512696:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8c00/0x8db73d43f5504cd7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357897 expref: 12 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.512738:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3b217b00) 00010000:00010000:1.0:1782727577.512828:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782727577.512848:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6a00/0x8db73d43f5504cde lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c39735789e expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513001:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6800/0x8db73d43f5504ce5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513014:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6800/0x8db73d43f5504ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513024:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6800/0x8db73d43f5504ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513035:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7c00/0x8db73d43f5504cec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513106:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7c00/0x8db73d43f5504cec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513114:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7c00/0x8db73d43f5504cec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513178:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7200/0x8db73d43f5504cf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513186:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7200/0x8db73d43f5504cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513193:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7200/0x8db73d43f5504cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727577.513208:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00010000:00010000:1.0:1782727577.513290:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6800/0x8db73d43f5504ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513298:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6800/0x8db73d43f5504ce5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513305:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6800/0x8db73d43f5504ce5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513310:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae37da6800 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:1.0:1782727577.513314:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6800/0x8db73d43f5504ce5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513322:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6800/0x8db73d43f5504ce5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513331:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae106df900) 00010000:00010000:1.0:1782727577.513335:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727577.513338:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6800/0x8db73d43f5504ce5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513344:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6800/0x8db73d43f5504ce5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513354:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7c00/0x8db73d43f5504cec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513360:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7c00/0x8db73d43f5504cec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513763:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7c00/0x8db73d43f5504cec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513769:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae37da7c00 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:1.0:1782727577.513772:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7c00/0x8db73d43f5504cec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513778:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7c00/0x8db73d43f5504cec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513788:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff90ae106dff00) 00010000:00010000:1.0:1782727577.513790:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727577.513793:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7c00/0x8db73d43f5504cec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513799:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7c00/0x8db73d43f5504cec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513843:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6a00/0x8db73d43f5504cde lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735789e expref: 14 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513859:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7200/0x8db73d43f5504cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735789e expref: 13 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.513866:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff90ae106dfa00) 00010000:00010000:1.0:1782727577.513868:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782727577.513871:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae37da7200, rc 0) 00000100:00100000:1.0:1782727577.513950:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+13:11852:x1869325080223104:12345-192.168.204.35@tcp:101:dd.0 Request processed in 1305us (2110us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1782727577.513967:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 45 00000100:00100000:0.0:1782727577.520215:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727577.520305:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080223232 00000100:00100000:1.0:1782727577.520316:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080223232 00000100:00100000:1.0:1782727577.520475:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 46 00000100:00100000:1.0:1782727577.520487:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+13:11852:x1869325080223232:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:1.0:1782727577.520584:0:5952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727577.520605:0:5952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6a00/0x8db73d43f5504d01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c3973578a5 expref: -99 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.520831:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7c00/0x8db73d43f5504d08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.520845:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7c00/0x8db73d43f5504d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.520856:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7c00/0x8db73d43f5504d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.520989:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6a00/0x8db73d43f5504d01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973578a5 expref: 15 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.521007:0:5952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7c00/0x8db73d43f5504d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973578a5 expref: 14 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.521016:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff90ae106dfa00) 00010000:00010000:1.0:1782727577.521020:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782727577.521024:0:5952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae37da7c00, rc 0) 00000100:00100000:1.0:1782727577.522568:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+14:11852:x1869325080223232:12345-192.168.204.35@tcp:101:dd.0 Request processed in 2071us (2355us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727577.522596:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 46 00000100:00100000:0.0:1782727577.534071:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727577.534417:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080223488 00000100:00100000:2.0:1782727577.534430:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080223488 00000100:00100000:2.0:1782727577.534504:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 47 00000100:00100000:2.0:1782727577.534639:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e09f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+14:11852:x1869325080223488:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:2.0:1782727577.534701:0:5953:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727577.534733:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7200/0x8db73d43f5504cf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c39735789e expref: 14 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.534869:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff90ae106dfa00) 00010000:00010000:2.0:1782727577.534874:0:5953:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782727577.535052:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9800/0x8db73d43f5504d0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.535067:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9800/0x8db73d43f5504d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.535077:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9800/0x8db73d43f5504d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782727577.535170:0:5953:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000004:00010000:2.0:1782727577.535208:0:5953:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000068ab5c57 reply state 0000000090e12708 transno 4294967320 ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9800/0x8db73d43f5504d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727577.535218:0:5953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782727577.535317:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e09f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+16:11852:x1869325080223488:12345-192.168.204.35@tcp:36:dd.0 Request processed in 694us (1259us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1782727577.535326:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 47 00000020:00080000:2.0:1782727577.535331:0:5953:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782727577.540725:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9800/0x8db73d43f5504d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.540818:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9800/0x8db73d43f5504d0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.541052:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9800/0x8db73d43f5504d0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.541059:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae033b9800 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:1.0:1782727577.541064:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9800/0x8db73d43f5504d0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.541073:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9800/0x8db73d43f5504d0f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.541092:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff90ae106dfa00) 00010000:00010000:1.0:1782727577.541095:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727577.541101:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9800/0x8db73d43f5504d0f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.541107:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9800/0x8db73d43f5504d0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727577.545739:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727577.546230:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080223616 00000100:00100000:1.0:1782727577.546242:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080223616 00000100:00100000:1.0:1782727577.546318:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:1.0:1782727577.546328:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+6:11852:x1869325080223616:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:1.0:1782727577.546346:0:6939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727577.546420:0:6939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ada06777/0x8db73d43f5504d16 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c3973578ac expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782727577.546454:0:6939:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782727577.546476:0:6939:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=301s v=(0 0) 00010000:00010000:1.0:1782727577.546480:0:6939:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782727577.546489:0:6939:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ada06777/0x8db73d43f5504d16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973578ac expref: 7 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.546508:0:6939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ada06777/0x8db73d43f5504d16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973578ac expref: 7 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727577.546520:0:6939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae37da6a00, rc 0) 00000100:00100000:1.0:1782727577.546574:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+7:11852:x1869325080223616:12345-192.168.204.35@tcp:101:dd.0 Request processed in 248us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727577.546580:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00080000:0.0:1782727577.547002:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727577.553860:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727577.554430:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080223744 00000100:00100000:2.0:1782727577.554449:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080223744 00000100:00100000:2.0:1782727577.554553:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:2.0:1782727577.554565:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+5:11852:x1869325080223744:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1782727577.554582:0:6941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727577.554605:0:6941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c648d2a/0x8db73d43f5504d1d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c3973578b3 expref: -99 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782727577.554631:0:6941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782727577.554651:0:6941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=301s v=(0 0) 00010000:00010000:2.0:1782727577.554656:0:6941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782727577.554664:0:6941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c648d2a/0x8db73d43f5504d1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973578b3 expref: 6 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.554682:0:6941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c648d2a/0x8db73d43f5504d1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973578b3 expref: 6 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.554695:0:6941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae033b8e00, rc 0) 00000100:00100000:2.0:1782727577.554763:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+6:11852:x1869325080223744:12345-192.168.204.35@tcp:101:dd.0 Request processed in 201us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727577.554769:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00080000:0.0:1782727577.554847:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727577.562728:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727577.563239:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080223872 00000100:00100000:2.0:1782727577.563255:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080223872 00002000:00010000:2.0:1782727577.563302:0:6944:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/4 (0->18446744073709551615) 00002000:00100000:2.0:1782727577.563307:0:6944:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90ae2a74fb80 with x1869325080223872 ext(0->18446744073709551615) 00002000:00010000:2.0:1782727577.563320:0:6944:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ae2a74fb80. 00000100:00100000:2.0:1782727577.563362:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00100000:2.0:1782727577.563423:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae2a74fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+7:2351:x1869325080223872:12345-192.168.204.35@tcp:10:dd.0 00002000:00010000:2.0:1782727577.563686:0:6944:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782727577.563690:0:6944:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782727576 00002000:00010000:2.0:1782727577.563693:0:6944:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782727577.563695:0:6944:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1782727576 00002000:00010000:2.0:1782727577.563697:0:6944:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1782727577.563760:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae2a74fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+8:2351:x1869325080223872:12345-192.168.204.35@tcp:10:dd.0 Request processed in 389us (1044us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782727577.563769:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 0 00002000:00010000:2.0:1782727577.563773:0:6944:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/4 (0->18446744073709551615) 00002000:00100000:2.0:1782727577.563776:0:6944:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90ae2a74fb80 with x1869325080223872 ext(0->18446744073709551615) 00002000:00010000:2.0:1782727577.563780:0:6944:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ae2a74fb80. 00000100:00100000:3.0:1782727577.573220:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727577.573736:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080224000 00000100:00100000:0.0:1782727577.573748:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080224000 00002000:00010000:0.0:1782727577.573791:0:6946:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1782727577.573797:0:6946:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90ae0354ea00 with x1869325080224000 ext(0->18446744073709551615) 00002000:00010000:0.0:1782727577.573809:0:6946:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ae0354ea00. 00000100:00100000:0.0:1782727577.573847:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1 00000100:00100000:0.0:1782727577.573857:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0354ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+6:2350:x1869325080224000:12345-192.168.204.35@tcp:10:dd.0 00002000:00010000:0.0:1782727577.574065:0:6946:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1782727577.574069:0:6946:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782727576 00002000:00010000:0.0:1782727577.574072:0:6946:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1782727577.574074:0:6946:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1782727576 00002000:00010000:0.0:1782727577.574077:0:6946:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1782727577.574140:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0354ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+7:2350:x1869325080224000:12345-192.168.204.35@tcp:10:dd.0 Request processed in 283us (933us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1782727577.574148:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1 00002000:00010000:0.0:1782727577.574152:0:6946:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1782727577.574155:0:6946:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90ae0354ea00 with x1869325080224000 ext(0->18446744073709551615) 00002000:00010000:0.0:1782727577.574160:0:6946:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ae0354ea00. 00000100:00100000:0.0:1782727577.616805:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727577.622184:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080224256 00000100:00100000:2.0:1782727577.622206:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080224256 00000100:00100000:2.0:1782727577.622365:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:2.0:1782727577.622397:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae26e3d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+15:11852:x1869325080224256:12345-192.168.204.35@tcp:35:dd.0 00000100:00100000:2.0:1782727577.622780:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae26e3d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+16:11852:x1869325080224256:12345-192.168.204.35@tcp:35:dd.0 Request processed in 386us (5987us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1782727577.622788:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 10 00010000:00010000:0.0:1782727577.637861:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727577.643484:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727577.650753:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080224384 00000100:00100000:3.0:1782727577.650771:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080224384 00002000:00100000:3.0:1782727577.650831:0:6945:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->131071) req@ffff90ae3dfb0000 x1869325080224384/t0(0) o4->f875d55c-258d-46bd-8e2e-5a5be22638df@192.168.204.35@tcp:448/0 lens 488/0 e 0 to 0 dl 1782727588 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782727577.650842:0:6945:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90ae3dfb0000 with x1869325080224384 ext(0->131071) 00002000:00010000:3.0:1782727577.650848:0:6945:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ae3dfb0000 00000100:00100000:3.0:1782727577.650890:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2 00000100:00100000:3.0:1782727577.650902:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+8:2352:x1869325080224384:12345-192.168.204.35@tcp:4:dd.0 00000100:00100000:3.0:1782727577.665752:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+10:2352:x1869325080224384:12345-192.168.204.35@tcp:4:dd.0 Request processed in 14833us (22259us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1782727577.665767:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2 00002000:00100000:3.0:1782727577.665781:0:6945:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->131071) req@ffff90ae3dfb0000 x1869325080224384/t4294967302(0) o4->f875d55c-258d-46bd-8e2e-5a5be22638df@192.168.204.35@tcp:448/0 lens 488/448 e 0 to 0 dl 1782727588 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782727577.665792:0:6945:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90ae3dfb0000 with x1869325080224384 ext(0->131071) 00002000:00010000:3.0:1782727577.665802:0:6945:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ae3dfb0000 00000100:00100000:1.0:1782727577.709899:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727577.710022:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080224512 00000100:00100000:2.0:1782727577.710033:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080224512 00000100:00100000:2.0:1782727577.710106:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 48 00000100:00100000:2.0:1782727577.710115:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+16:11854:x1869325080224512:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:2.0:1782727577.710140:0:8842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727577.710166:0:8842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504d24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c3973578ba expref: -99 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.710279:0:8842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504d2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.710294:0:8842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504d2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.710305:0:8842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504d2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727577.710353:0:8842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782727577.710356:0:8842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727577.710424:0:8842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504d2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.710461:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504d24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973578ba expref: 18 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.710480:0:8842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504d2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973578ba expref: 17 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.710488:0:8842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3b217e00) 00010000:00010000:2.0:1782727577.710492:0:8842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782727577.710495:0:8842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae033b8000, rc 0) 00000100:00100000:2.0:1782727577.710550:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+17:11854:x1869325080224512:12345-192.168.204.35@tcp:101:rm.0 Request processed in 436us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727577.710558:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 48 00000100:00100000:1.0:1782727577.722171:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727577.722303:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080224640 00000100:00100000:2.0:1782727577.722315:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080224640 00000100:00100000:2.0:1782727577.722452:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 49 00000100:00100000:2.0:1782727577.722465:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+17:11854:x1869325080224640:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:2.0:1782727577.722491:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727577.722519:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504d32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c3973578c1 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.722611:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.722643:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.722659:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.722678:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.722685:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.722691:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.722787:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504d47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.722796:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.722815:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727577.722881:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 131072 00000004:00200000:2.0:1782727577.722886:0:5953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727577.722911:0:5953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.722926:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.722936:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.722943:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d39 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.722951:0:5953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.722958:0:5953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae033b9000 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:2.0:1782727577.722963:0:5953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.722971:0:5953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.722988:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3b217e00) 00010000:00010000:2.0:1782727577.722991:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727577.722997:0:5953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.723004:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.723030:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.723037:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.723043:0:5953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.723048:0:5953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae033b9e00 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:2.0:1782727577.723051:0:5953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.723058:0:5953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.723066:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff90ae3b217a00) 00010000:00010000:2.0:1782727577.723068:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727577.723071:0:5953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.723077:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.723112:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504d32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973578c1 expref: 19 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.723126:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504d47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973578c1 expref: 18 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.723146:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff90ae106dfa00) 00010000:00010000:2.0:1782727577.723149:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782727577.723152:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae033b9a00, rc 0) 00000100:00100000:2.0:1782727577.723241:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+18:11854:x1869325080224640:12345-192.168.204.35@tcp:101:rm.0 Request processed in 778us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727577.723249:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 49 00000100:00100000:0.0:1782727577.736024:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727577.740716:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080224896 00000100:00100000:2.0:1782727577.740741:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080224896 00000100:00100000:2.0:1782727577.740921:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 50 00000100:00100000:2.0:1782727577.740936:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e09ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+18:11854:x1869325080224896:12345-192.168.204.35@tcp:36:rm.0 00010000:00010000:2.0:1782727577.741021:0:8842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1782727577.741064:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504d47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973578c1 expref: 18 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.741094:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da7c00/0x8db73d43f5504d08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973578a5 expref: 17 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.741110:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae37da6e00/0x8db73d43f5504cc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c397357890 expref: 16 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.741124:0:8842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff90ae106dfa00) 00010000:00010000:2.0:1782727577.741145:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504d2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973578ba expref: 15 pid: 8842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.741155:0:8842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3b217e00) 00010000:00010000:2.0:1782727577.741180:0:8842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782727577.741217:0:8842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504d4e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.741234:0:8842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504d4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.741260:0:8842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504d4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.741276:0:8842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d55 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.741284:0:8842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.741291:0:8842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.741578:0:8842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d5c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.741587:0:8842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.741595:0:8842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782727577.742094:0:8842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1782727577.742108:0:8842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 302023734072ns, next at 303023730713ns, rc = 0 00000040:00080000:2.0:1782727577.742136:0:8842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1782727577.742142:0:8842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 302023769032ns, next at 303023767933ns, rc = 0 00010000:00010000:2.0:1782727577.742200:0:8842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8400/0x8db73d43f5504d63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.742222:0:8842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8400/0x8db73d43f5504d63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.742231:0:8842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8400/0x8db73d43f5504d63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.742240:0:8842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8400/0x8db73d43f5504d63 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.742247:0:8842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8400/0x8db73d43f5504d63 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.742253:0:8842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8400/0x8db73d43f5504d63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.742417:0:8842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782727577.742450:0:8842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.742457:0:8842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d5c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.742464:0:8842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d5c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.742471:0:8842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae033b9000 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:2.0:1782727577.742476:0:8842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d5c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.742483:0:8842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d5c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.742507:0:8842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff90ae3b217000) 00010000:00010000:2.0:1782727577.742510:0:8842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782727577.742514:0:8842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d5c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.742521:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d5c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.742539:0:8842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504d4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.742545:0:8842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504d4e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.742552:0:8842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504d4e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.742557:0:8842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae033b8200 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:2.0:1782727577.742560:0:8842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504d4e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.742567:0:8842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504d4e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.742573:0:8842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3b217a00) 00010000:00010000:2.0:1782727577.742576:0:8842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727577.742579:0:8842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504d4e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727577.742585:0:8842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8200/0x8db73d43f5504d4e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782727577.742610:0:8842:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000acf38eee reply state 00000000f394ca22 transno 4294967322 ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727577.742634:0:8842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782727577.742741:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e09ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f875d55c-258d-46bd-8e2e-5a5be22638df+16:11854:x1869325080224896:12345-192.168.204.35@tcp:36:rm.0 Request processed in 1805us (6727us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1782727577.742750:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 50 00010000:00010000:0.0:1782727577.748026:0:8017:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727577.748045:0:8017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8400/0x8db73d43f5504d63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727577.748060:0:8017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae033b8400 already unused, calling callback (ffffffffc0b2bcf0) 00010000:00010000:0.0:1782727577.748065:0:8017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8400/0x8db73d43f5504d63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727577.748077:0:8017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8400/0x8db73d43f5504d63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727577.748100:0:8017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff90ae3b217000) 00010000:00010000:0.0:1782727577.748103:0:8017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782727577.748108:0:8017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8400/0x8db73d43f5504d63 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727577.748115:0:8017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8400/0x8db73d43f5504d63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727577.748143:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727577.748145:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727577.748147:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727577.749816:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727577.749835:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d55 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727577.749842:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d55 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727577.749871:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae033b9e00 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:0.0:1782727577.749877:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d55 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727577.749885:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d55 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727577.749905:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff90ae3b217c00) 00010000:00010000:0.0:1782727577.749909:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727577.749913:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d55 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727577.749919:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9e00/0x8db73d43f5504d55 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727578.662637:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782727578.793004:0:7333:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 303074628263ns, next at 304074625844ns, rc = 0 00000100:00100000:2.0:1782727578.793066:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782727578.793089:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100179456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727578.793162:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727578.793321:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100179456 00000100:00100000:1.0:1782727578.793329:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100179456 00000100:00100000:1.0:1782727578.793409:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782727578.793430:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100179456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782727578.793463:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125952 pending 155648 free 3923537920 avail 3692015616 00000100:00100000:1.0:1782727578.794570:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100179456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1136us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727578.794599:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1782727578.794625:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727578.798549:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100179456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727578.951913:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727578.952233:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080225024 00000100:00100000:3.0:1782727578.952244:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080225024 00000100:00100000:3.0:1782727578.952315:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 51 00000100:00100000:3.0:1782727578.952325:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+15:11896:x1869325080225024:12345-192.168.204.35@tcp:101:multiop.0 00010000:00010000:3.0:1782727578.952356:0:5953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727578.952425:0:5953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504d6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c3973578c8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727578.952510:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538200/0x8db73d43f5504d71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727578.952526:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538200/0x8db73d43f5504d71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727578.952539:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538200/0x8db73d43f5504d71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727578.952589:0:5953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782727578.952739:0:5953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782727578.952767:0:5953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538200/0x8db73d43f5504d71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727578.952793:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01539800/0x8db73d43f5504d6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973578c8 expref: 17 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727578.952811:0:5953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538200/0x8db73d43f5504d71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973578c8 expref: 16 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727578.952819:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae03597a00) 00010000:00010000:3.0:1782727578.952822:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782727578.952825:0:5953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae01538200, rc 0) 00000100:00100000:3.0:1782727578.952896:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+16:11896:x1869325080225024:12345-192.168.204.35@tcp:101:multiop.0 Request processed in 572us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727578.952903:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 51 00000100:00100000:1.0:1782727578.970358:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1782727578.970585:0:5952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080225280 00000100:00100000:2.0:1782727578.970606:0:5952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080225280 00000100:00100000:2.0:1782727578.970687:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00100000:2.0:1782727578.970698:0:5952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+16:11896:x1869325080225280:12345-192.168.204.35@tcp:101:multiop.0 00010000:00010000:2.0:1782727578.970723:0:5952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727578.970727:0:5952:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782727578.970755:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae01538200/0x8db73d43f5504d71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973578c8 expref: 16 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.970785:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae03597a00) 00010000:00010000:2.0:1782727578.970797:0:5952:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782727578.970813:0:5952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d78 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c3973578cf expref: -99 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.970941:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504d7f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.970963:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504d7f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.970972:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504d7f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.970986:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504d86 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.970991:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504d86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.970997:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504d86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782727578.971342:0:5952:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1782727578.971539:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8600/0x8db73d43f5504d8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.971549:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8600/0x8db73d43f5504d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.971557:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8600/0x8db73d43f5504d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.971587:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504d7f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.971594:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504d7f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.971601:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504d7f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.971615:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae033b8000 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:2.0:1782727578.971619:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504d7f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.971627:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504d7f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.971637:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ae3b217a00) 00010000:00010000:2.0:1782727578.971639:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727578.971642:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504d7f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.971648:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8000/0x8db73d43f5504d7f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782727578.971660:0:5952:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aa5556d8 reply state 0000000058eaa2e6 transno 4294967323 ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504d86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727578.971669:0:5952:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782727578.971695:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9000/0x8db73d43f5504d78 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973578cf expref: 18 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.971711:0:5952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b8600/0x8db73d43f5504d8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973578cf expref: 17 pid: 5952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.971718:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90ae3b217800) 00010000:00010000:2.0:1782727578.971721:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782727578.971723:0:5952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae033b8600, rc 0) 00000100:00100000:2.0:1782727578.971811:0:5952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+18:11896:x1869325080225280:12345-192.168.204.35@tcp:101:multiop.0 Request processed in 1115us (1462us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1782727578.971825:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 52 00010000:00010000:2.0:1782727578.975091:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504d86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.975112:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504d86 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.975120:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504d86 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.975125:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ae033b9a00 already unused, calling callback (ffffffffc171f4f0) 00010000:00010000:2.0:1782727578.975129:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504d86 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.975136:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504d86 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.975155:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x11a4e1a9 (ffff90ae3b217e00) 00010000:00010000:2.0:1782727578.975157:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727578.975162:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504d86 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727578.975168:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ae033b9a00/0x8db73d43f5504d86 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727578.980901:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727578.983754:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080225408 00000100:00100000:0.0:1782727578.983774:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080225408 00000100:00100000:1.0:1782727578.984726:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00100000:1.0:1782727578.984739:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+10:11896:x1869325080225408:12345-192.168.204.35@tcp:101:multiop.0 00010000:00010000:1.0:1782727578.984763:0:6939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727578.984785:0:6939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000848bf2b9/0x8db73d43f5504d9b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9cd528c3973578d6 expref: -99 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782727578.984812:0:6939:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782727578.984836:0:6939:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=303s v=(0 0) 00010000:00010000:1.0:1782727578.984840:0:6939:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782727578.984849:0:6939:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000848bf2b9/0x8db73d43f5504d9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973578d6 expref: 11 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727578.984868:0:6939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000848bf2b9/0x8db73d43f5504d9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x9cd528c3973578d6 expref: 11 pid: 6939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727578.984881:0:6939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ae37da7800, rc 0) 00000100:00100000:1.0:1782727578.984949:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+11:11896:x1869325080225408:12345-192.168.204.35@tcp:101:multiop.0 Request processed in 212us (4061us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727578.984957:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00100000:1.0:1782727578.989478:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727578.989574:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080225536 00000100:00100000:0.0:1782727578.989585:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080225536 00002000:00100000:0.0:1782727578.989650:0:6944:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->4095) req@ffff90ae3dfb2680 x1869325080225536/t0(0) o4->f875d55c-258d-46bd-8e2e-5a5be22638df@192.168.204.35@tcp:449/0 lens 4584/0 e 0 to 0 dl 1782727589 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782727578.989663:0:6944:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90ae3dfb2680 with x1869325080225536 ext(0->4095) 00002000:00010000:0.0:1782727578.989668:0:6944:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ae3dfb2680 00000100:00100000:0.0:1782727578.989706:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 3 00000100:00100000:0.0:1782727578.989717:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+11:2351:x1869325080225536:12345-192.168.204.35@tcp:4:multiop.0 00000001:00020000:0.0:1782727578.989733:0:6944:0:(tgt_handler.c:2756:tgt_brw_write()) cfs_fail_timeout id 216 sleeping for 1000ms 00010000:00010000:0.0:1782727579.686560:0:5941:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727579.951657:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727579.951761:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1782727579.951815:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1782727579.951830:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080225792 00000100:00100000:0.0:1782727579.951846:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080225792 00000100:00100000:1.0:1782727579.951867:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00080000:1.0:1782727579.951895:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727579.951912:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080226048 00000100:00100000:1.0:1782727579.951917:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080226048 00000100:00100000:0.0:1782727579.951919:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 114 00000100:00100000:0.0:1782727579.951934:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+17:2352:x1869325080225792:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1782727579.951957:0:6940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080225920 00000100:00100000:1.0:1782727579.951961:0:6940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080225920 00000100:00100000:1.0:1782727579.951985:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 51 00000100:00100000:1.0:1782727579.951994:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+7:2352:x1869325080226048:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1782727579.952030:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f875d55c-258d-46bd-8e2e-5a5be22638df+17:2352:x1869325080225792:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 99us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727579.952034:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+7:2352:x1869325080226048:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 39us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727579.952043:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 114 00000100:00100000:1.0:1782727579.952047:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 51 00000100:00100000:1.0:1782727579.952067:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00100000:1.0:1782727579.952075:0:6940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3dfb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+12:2353:x1869325080225920:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1782727579.952119:0:6940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+12:2353:x1869325080225920:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 45us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727579.952136:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00080000:1.0:1782727579.952157:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782727579.952160:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782727579.955593:0:5944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080225664 00000100:00100000:2.0:1782727579.955611:0:5944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080225664 00000100:00100000:2.0:1782727579.955689:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 242 00000100:00100000:2.0:1782727579.955710:0:5944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2352:x1869325080225664:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1782727579.955815:0:5944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b67c46fe-bdce-4fa5-ac17-5bb374207e90+10:2352:x1869325080225664:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 105us (4171us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727579.955840:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 242 00000001:00020000:0.0:1782727580.037709:0:6944:0:(tgt_handler.c:2756:tgt_brw_write()) cfs_fail_timeout id 216 awake 00000100:00100000:0.0:1782727580.049179:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3dfb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f875d55c-258d-46bd-8e2e-5a5be22638df+11:2351:x1869325080225536:12345-192.168.204.35@tcp:4:multiop.0 Request processed in 1059448us (1059701us total) trans 0 rc -30/-30 00000100:00100000:0.0:1782727580.049195:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 3 00002000:00100000:0.0:1782727580.049210:0:6944:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->4095) req@ffff90ae3dfb2680 x1869325080225536/t0(0) o4->f875d55c-258d-46bd-8e2e-5a5be22638df@192.168.204.35@tcp:449/0 lens 4584/224 e 0 to 0 dl 1782727589 ref 1 fl Complete:/600/0 rc -30/-30 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782727580.049223:0:6944:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90ae3dfb2680 with x1869325080225536 ext(0->4095) 00002000:00010000:0.0:1782727580.049230:0:6944:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ae3dfb2680 00000100:00100000:2.0:1782727580.326655:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e0aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325100179840:0@lo:400:kworker.0 00000100:00100000:2.0:1782727580.326730:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727580.326795:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782727580.326802:0:3445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e0ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100179968:0@lo:400:kworker.0 00000100:00100000:2.0:1782727580.326830:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727580.326885:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100179968 00000100:00100000:2.0:1782727580.326893:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100179968 00000100:00100000:2.0:1782727580.326952:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782727580.326961:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e0a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100179968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727580.327190:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3df86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100179584:0@lo:400:kworker.0 00000100:00100000:0.0:1782727580.327228:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727580.327254:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e0a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325100180096:0@lo:400:kworker.0 00000100:00100000:0.0:1782727580.327288:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727580.327308:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782727580.327314:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae2a74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325100179712:0@lo:400:kworker.0 00000100:00100000:0.0:1782727580.327352:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727580.327369:0:3443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3e0a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100180224:0@lo:400:kworker.0 00000100:00100000:0.0:1782727580.327421:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727580.327445:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100179840 00000100:00100000:0.0:1782727580.327456:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100179840 00000100:00100000:0.0:1782727580.327486:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100180096 00000100:00100000:0.0:1782727580.327489:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100180096 00000100:00100000:0.0:1782727580.327501:0:8842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100179712 00000100:00100000:0.0:1782727580.327503:0:8842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100179712 00000100:00100000:0.0:1782727580.327516:0:8842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1782727580.327523:0:8842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325100179840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727580.328197:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1782727580.328209:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325100180096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727580.328262:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1869325100180096:12345-0@lo:400:kworker.0 Request processed in 57us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727580.328269:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1782727580.328288:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1782727580.328293:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325100179712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727580.328316:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1869325100179712:12345-0@lo:400:kworker.0 Request processed in 23us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727580.328321:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1782727580.328425:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae2a74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1869325100179712:0@lo:400:kworker.0 00000100:00100000:3.0:1782727580.328439:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e0a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1869325100180096:0@lo:400:kworker.0 00000100:00100000:3.0:1782727580.328481:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100180224 00000100:00100000:3.0:1782727580.328486:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100180224 00000100:00100000:3.0:1782727580.328514:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782727580.328520:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3df4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100180224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727580.328553:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3df4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1869325100180224:12345-0@lo:400:kworker.0 Request processed in 33us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727580.328560:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1782727580.328592:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782727580.328596:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782727580.328598:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727580.328614:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e0a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1869325100180224:0@lo:400:kworker.0 00000100:00100000:3.0:1782727580.328771:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100179584 00000100:00100000:3.0:1782727580.328775:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100179584 00000100:00100000:3.0:1782727580.328801:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1782727580.328808:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae0f40d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100179584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727580.328856:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae0f40d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0332f07-5c7b-4a87-aafc-b3671573fb48+19:3443:x1869325100179584:12345-0@lo:400:kworker.0 Request processed in 48us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727580.328862:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1782727580.328911:0:3443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3df86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0332f07-5c7b-4a87-aafc-b3671573fb48:3443:1869325100179584:0@lo:400:kworker.0 00000100:00100000:0.0:1782727580.329699:0:8842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1869325100179840:12345-0@lo:400:kworker.0 Request processed in 2172us (2965us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727580.329709:0:8842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1782727580.329814:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e0a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1869325100179968:12345-0@lo:400:kworker.0 Request processed in 2851us (2980us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727580.329822:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:1.0:1782727580.330015:0:8488:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 304611640611ns, next at 305611637148ns, rc = 0 00000100:00100000:2.0:1782727580.330678:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727580.330703:0:3446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff90ae3dde1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100180352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727580.330764:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727580.330889:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325100180352 00000100:00100000:1.0:1782727580.330897:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325100180352 00000100:00100000:1.0:1782727580.331029:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782727580.331038:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e0ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100180352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727580.331359:0:6942:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1782727580.331690:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e0ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1869325100180352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 651us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727580.331719:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782727580.331827:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e0ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1869325100179968:0@lo:400:kworker.0 00000100:00100000:3.0:1782727580.331844:0:3445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3e0aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1869325100179840:0@lo:400:kworker.0 00000100:00100000:2.0:1782727580.331880:0:3446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff90ae3dde1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1869325100180352:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782727580.710520:0:8017:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727581.104030:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1782727581.104149:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325080226176 00000100:00100000:3.0:1782727581.104161:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325080226176 00002000:00100000:3.0:1782727581.104227:0:6945:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->4095) req@ffff90ae3e0a8a80 x1869325080226176/t0(0) o4->f875d55c-258d-46bd-8e2e-5a5be22638df@192.168.204.35@tcp:452/0 lens 4584/0 e 0 to 0 dl 1782727592 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782727581.104239:0:6945:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90ae3e0a8a80 with x1869325080226176 ext(0->4095) 00002000:00010000:3.0:1782727581.104245:0:6945:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ae3e0a8a80 00000100:00100000:3.0:1782727581.104284:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4 00000100:00100000:3.0:1782727581.104296:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ae3e0a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+11:2350:x1869325080226176:12345-192.168.204.35@tcp:4:multiop.0 00000001:00020000:3.0:1782727581.104314:0:6945:0:(tgt_handler.c:2756:tgt_brw_write()) cfs_fail_timeout id 216 sleeping for 1000ms 00000100:00080000:1.0:1782727581.104869:0:5948:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1782727581.280588:0:12692:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_118c: @@@@@@ FAIL: No page in writeback, writeback=0 00010000:00010000:1.0:1782727581.734261:0:5940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:3.0:1782727582.149795:0:6945:0:(tgt_handler.c:2756:tgt_brw_write()) cfs_fail_timeout id 216 awake 00000100:00100000:3.0:1782727582.159302:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ae3e0a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f875d55c-258d-46bd-8e2e-5a5be22638df+11:2350:x1869325080226176:12345-192.168.204.35@tcp:4:multiop.0 Request processed in 1054992us (1055268us total) trans 0 rc -30/-30 00000100:00100000:3.0:1782727582.159328:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4 00002000:00100000:3.0:1782727582.159345:0:6945:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->4095) req@ffff90ae3e0a8a80 x1869325080226176/t0(0) o4->f875d55c-258d-46bd-8e2e-5a5be22638df@192.168.204.35@tcp:452/0 lens 4584/224 e 0 to 0 dl 1782727592 ref 1 fl Complete:/600/0 rc -30/-30 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782727582.159366:0:6945:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff90ae3e0a8a80 with x1869325080226176 ext(0->4095) 00002000:00010000:3.0:1782727582.159404:0:6945:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ae3e0a8a80 Debug log: 10564 lines, 10564 kept, 0 dropped, 0 bad.